Jul 06 15:18:24 devstack cinder-volume[75003]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 06 15:18:24 devstack cinder-volume[75003]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 15:18:24 devstack cinder-volume[75003]: we strongly recommend against using it for new projects.
Jul 06 15:18:24 devstack cinder-volume[75003]: If you are already using Eventlet, we recommend migrating to a different
Jul 06 15:18:24 devstack cinder-volume[75003]: framework.  For more detail see
Jul 06 15:18:24 devstack cinder-volume[75003]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 15:18:24 devstack cinder-volume[75003]:   import eventlet  # noqa
Jul 06 15:18:27 devstack cinder-volume[75003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 15:18:27 devstack cinder-volume[75003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 15:18:27 devstack cinder-volume[75003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 15:18:28 devstack cinder-volume[75003]: INFO dbcounter [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Registered counter for database cinder
Jul 06 15:18:28 devstack cinder-volume[75003]: DEBUG oslo_db.sqlalchemy.engines [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:18:28 devstack cinder-volume[75003]: DEBUG dbcounter [-] [75003] Writer thread running {{(pid=75003) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 15:18:28 devstack cinder-volume[75003]: INFO cinder.rpc [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 06 15:18:28 devstack cinder-volume[75003]: INFO cinder.rpc [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 06 15:18:28 devstack cinder-volume[75003]: DEBUG oslo_db.sqlalchemy.engines [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:18:28 devstack cinder-volume[75003]: INFO cinder.volume.manager [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Determined volume DB was empty at startup.
Jul 06 15:18:28 devstack cinder-volume[75003]: DEBUG cinder.volume.manager [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75003) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 06 15:18:28 devstack cinder-volume[75003]: INFO cinder.volume.manager [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 06 15:18:28 devstack cinder-volume[75003]: WARNING stevedore.named [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 15:18:28 devstack cinder-volume[75003]: WARNING castellan.key_manager [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 15:18:28 devstack cinder-volume[75003]: WARNING cinder.keymgr.conf_key_mgr [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 15:18:28 devstack cinder-volume[75003]: DEBUG cinder.volume.drivers.lvm [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75003) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 06 15:18:28 devstack cinder-volume[75003]: DEBUG oslo_concurrency.processutils [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75003) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_concurrency.processutils [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] CMD "cinder-rtstool verify" returned: 0 in 0.390s {{(pid=75003) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_db.sqlalchemy.engines [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:18:29 devstack cinder-volume[75003]: INFO cinder.rpc [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 06 15:18:29 devstack cinder-volume[75003]: INFO cinder.rpc [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 06 15:18:29 devstack cinder-volume[75003]: WARNING stevedore.named [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 15:18:29 devstack cinder-volume[75003]: WARNING castellan.key_manager [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 15:18:29 devstack cinder-volume[75003]: INFO cinder.volume.manager [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_db.sqlalchemy.engines [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:18:29 devstack cinder-volume[75003]: INFO oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Starting 1 workers
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Started child 75176 {{(pid=75003) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Full set of CONF: {{(pid=75003) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] ******************************************************************************** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Configuration options gathered from: {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] ================================================================================ {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] allow_availability_zone_fallback = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] allow_compression_on_image_upload = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] allowed_direct_url_schemes     = [] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] api_rate_limit                 = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] auth_strategy                  = keystone {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] az_cache_duration              = 3600 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_availability_zone      = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_host                   = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_name                   = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_stats_polling_interval = 60 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backup_api_class               = cinder.backup.api.API {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backup_name_template           = backup-%s {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backup_use_same_host           = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backup_use_temp_snapshot       = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] chap_password                  = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] chap_username                  =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cinder_internal_tenant_project_id = c50676c35eb54f1c869cb4f5167b334d {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cinder_internal_tenant_user_id = 90c2658acd7b451f9ac9f683e3ecf63a {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cloned_volume_same_az          = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cluster                        = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] compression_format             = gzip {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] config_dir                     = [] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75176]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] config_source                  = [] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] control_exchange               = openstack {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] debug                          = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] default_availability_zone      = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] default_group_type             = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] default_volume_type            = lvmdriver-1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] disk_geometry                  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] driver_client_cert             = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] driver_client_cert_key         = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] driver_data_namespace          = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] driver_ssl_cert_path           = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] driver_ssl_cert_verify         = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] driver_use_ssl                 = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] enable_force_upload            = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] enable_new_services            = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] enable_unsupported_driver      = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] enforce_multipath_for_image_xfer = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] filter_function                = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance_api_insecure            = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance_api_servers             = ['http://192.168.122.18/image'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance_api_ssl_compression     = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance_ca_certificates_file    = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance_certfile                = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance_keyfile                 = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance_num_retries             = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance_request_timeout         = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] goodness_function              = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] graceful_shutdown_timeout      = 5 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] group_api_class                = cinder.group.api.API {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] host                           = devstack {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] image_compress_on_upload       = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] image_conversion_address_space_limit = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] image_conversion_cpu_limit     = 60 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] image_conversion_disable       = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] image_upload_use_cinder_backend = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] image_upload_use_internal_tenant = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] image_volume_cache_enabled     = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] image_volume_cache_max_count   = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] image_volume_cache_max_size_gb = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] init_host_max_objects_retrieval = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] iscsi_target_flags             =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] iscsi_write_cache              = on {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] iser_helper                    = tgtadm {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] iser_ip_address                = 192.168.122.18 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] iser_port                      = 3260 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] log_color                      = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] log_config_append              = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack sudo[75181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] log_dir                        = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] log_file                       = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] log_options                    = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] log_rotate_interval            = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] log_rotate_interval_type       = days {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] log_rotation_type              = none {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack sudo[75181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] max_age                        = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] max_logfile_count              = 30 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] max_logfile_size_mb            = 200 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] max_over_subscription_ratio    = 20.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] message_reap_interval          = 86400 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] message_ttl                    = 2592000 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] migration_create_volume_timeout_secs = 300 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] monkey_patch                   = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] monkey_patch_modules           = [] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] my_ip                          = 192.168.122.18 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] no_snapshot_gb_quota           = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] num_iser_scan_tries            = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] num_shell_tries                = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] num_volume_device_scan_tries   = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] nvmeof_conn_info_version       = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] nvmet_ns_id                    = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] nvmet_port_id                  = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] osapi_max_limit                = 1000 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] osapi_volume_ext_list          = [] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] osapi_volume_listen_port       = 8776 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] osapi_volume_use_ssl           = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] osapi_volume_workers           = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] per_volume_size_limit          = -1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] periodic_fuzzy_delay           = 60 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] periodic_interval              = 60 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] public_endpoint                = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] publish_errors                 = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] quota_backup_gigabytes         = 1000 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] quota_backups                  = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] quota_gigabytes                = 1000 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] quota_groups                   = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] quota_snapshots                = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] quota_volumes                  = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] rate_limit_burst               = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] rate_limit_except_level        = CRITICAL {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] rate_limit_interval            = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] reinit_driver_count            = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] replication_device             = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] report_discard_supported       = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] report_interval                = 120 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] reservation_clean_interval     = 86400 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] reservation_expire             = 86400 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] reserved_image_namespaces      = [] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] reserved_percentage            = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] rpc_response_timeout           = 120 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] run_external_periodic_tasks    = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] scst_target_driver             = iscsi {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] scst_target_iqn_name           = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_down_time              = 720 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] shell_completion               = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] snapshot_name_template         = snapshot-%s {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] snapshot_same_host             = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] split_loggers                  = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] state_path                     = /opt/stack/data/cinder {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] storage_availability_zone      = nova {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] storage_protocol               = iSCSI {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] syslog_log_facility            = LOG_USER {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] target_helper                  = lioadm {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] target_ip_address              = 192.168.122.18 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] target_port                    = 3260 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] target_protocol                = iscsi {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] target_secondary_ip_addresses  = [] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] trace_flags                    = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] transport_url                  = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] until_refresh                  = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] use_chap_auth                  = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] use_default_quota_class        = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] use_journal                    = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] use_json                       = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] use_multipath_for_image_xfer   = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] use_stderr                     = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] use_syslog                     = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] verify_glance_signatures       = enabled {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_api_class               = cinder.volume.api.API {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_backend_name            = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_clear                   = zero {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_clear_ionice            = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_clear_size              = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_copy_bps_limit          = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_dd_blocksize            = 1M {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_name_template           = volume-%s {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_service_inithost_offload = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volume_usage_audit_period      = month {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] zoning_mode                    = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_concurrency.disable_process_locking = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.auth_section = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.auth_type   = password {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.auth_version = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.cache       = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.certfile    = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75176]: INFO cinder.volume.manager [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.include_service_catalog = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.insecure    = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:29 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.interface   = public {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.keyfile     = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_password =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcache_username =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.region_name = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.service_type = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.18/identity {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.backend                  = dogpile.cache.null {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.backend_argument         = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.backend_expiration_time  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.config_prefix            = cache.oslo {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.debug_cache_backend      = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.enable_retry_client      = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.enable_socket_keepalive  = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.enabled                  = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.expiration_time          = 600 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.hashclient_retry_attempts = 2 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.memcache_dead_retry      = 300 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.memcache_sasl_enabled    = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.password                 = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.proxies                  = [] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.redis_db                 = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.redis_server             = localhost:6379 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.retry_attempts           = 2 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.retry_delay              = 0.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.socket_keepalive_count   = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.socket_keepalive_idle    = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.socket_keepalive_interval = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.socket_timeout           = 1.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.tls_allowed_ciphers      = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.tls_cafile               = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.tls_certfile             = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.tls_enabled              = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.tls_keyfile              = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cache.username                 = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] coordination.backend_url       = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.asyncio_connection    = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.asyncio_slave_connection = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.backend               = sqlalchemy {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.connection            = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.connection_debug      = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.connection_parameters =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.connection_recycle_time = 3600 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.connection_trace      = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.db_inc_retry_interval = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.db_max_retries        = 20 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.db_max_retry_interval = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.db_retry_interval     = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.max_overflow          = 50 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.max_pool_size         = 5 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.max_retries           = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.mysql_wsrep_sync_wait = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.pool_timeout          = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.retry_interval        = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.slave_connection      = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.sqlite_synchronous    = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.synchronous_reader    = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] database.use_db_reconnect      = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.connection_string     = messaging:// {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.enabled               = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.es_doc_type           = notification {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.es_scroll_size        = 10000 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.es_scroll_time        = 2m {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.filter_error_trace    = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.hmac_keys             = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.sentinel_service_name = mymaster {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.socket_timeout        = 0.1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.trace_requests        = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler.trace_sqlalchemy      = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler_jaeger.process_tags   = {} {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler_jaeger.service_name_prefix = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] profiler_otlp.service_name_prefix = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.enforce_new_defaults = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.enforce_scope      = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.policy_default_rule = default {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] privsep_osbrick.group          = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] privsep_osbrick.helper_command = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] privsep_osbrick.user           = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cinder_sys_admin.group         = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cinder_sys_admin.helper_command = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] cinder_sys_admin.user          = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_user.auth_section      = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_user.auth_type         = password {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_user.cafile            = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_user.certfile          = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_user.collect_timing    = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_user.insecure          = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_user.keyfile           = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_user.send_service_user_token = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_user.split_loggers     = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] service_user.timeout           = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance.auth_section            = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance.auth_type               = password {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance.certfile                = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance.collect_timing          = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance.insecure                = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance.keyfile                 = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance.region_name             = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance.split_loggers           = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] glance.timeout                 = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.backend_availability_zone = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.chap_password = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.chap_username =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.disk_geometry = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.driver_client_cert = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.driver_client_cert_key = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.driver_data_namespace = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.driver_use_ssl = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.extra_capabilities = {} {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.filter_function = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.goodness_function = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.iscsi_target_flags =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.iscsi_write_cache = on {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.iser_ip_address = 192.168.122.18 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.iser_port     = 3260 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.lvm_share_target = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.lvm_type      = auto {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.num_shell_tries = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.replication_device = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.report_discard_supported = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.reserved_percentage = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.target_helper = tgtadm {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.target_ip_address = 192.168.122.18 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.target_port   = 3260 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.target_protocol = iscsi {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.trace_flags   = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.unique_fqdn_network = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.use_chap_auth = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.volume_backend_name = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.volume_clear  = zero {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.volume_clear_ionice = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.volume_clear_size = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_reports.file_event_handler = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_reports.log_dir           = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.backend_host       = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.chap_password      = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.chap_username      = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.disk_geometry      = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.driver_client_cert = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.extra_capabilities = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.filter_function    = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.goodness_function  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.iser_helper        = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.iser_port          = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.lvm_type           = auto {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.replication_device = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.report_discard_supported = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.reserved_percentage = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.scst_target_driver = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.storage_protocol   = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.target_ip_address  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.target_port        = 3260 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.trace_flags        = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.volume_clear       = zero {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] lvmdriver-1.volumes_dir        = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_notifications.driver = [] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_notifications.retry = -1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] key_manager.fixed_key          = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.barbican_api_version  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.barbican_endpoint     = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.barbican_endpoint_type = public {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.barbican_region_name  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.cafile                = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.certfile              = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.collect_timing        = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.insecure              = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.keyfile               = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.number_of_retries     = 60 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.retry_delay           = 1 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.send_service_user_token = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.split_loggers         = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.timeout               = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.verify_ssl            = True {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican.verify_ssl_path       = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican_service_user.auth_section = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican_service_user.auth_type = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican_service_user.cafile   = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican_service_user.certfile = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican_service_user.collect_timing = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican_service_user.insecure = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican_service_user.keyfile  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican_service_user.split_loggers = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] barbican_service_user.timeout  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.approle_role_id          = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.approle_secret_id        = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.kv_mountpoint            = secret {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.kv_path                  = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.kv_version               = 2 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.namespace                = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.root_token_id            = **** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.ssl_ca_crt_file          = None {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.timeout                  = 60.0 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.use_ssl                  = False {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:18:30 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] ******************************************************************************** {{(pid=75003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 06 15:18:30 devstack sudo[75181]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.804s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:30 devstack sudo[75213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:18:30 devstack sudo[75213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:31 devstack sudo[75213]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.634s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:18:31 devstack cinder-volume[75176]: INFO cinder.brick.local_dev.lvm [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 06 15:18:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:31 devstack sudo[75438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 15:18:31 devstack sudo[75438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:31 devstack sudo[75438]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:31 devstack cinder-volume[75176]: DEBUG cinder.brick.local_dev.lvm [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75176) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 06 15:18:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:31 devstack sudo[75659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:18:31 devstack sudo[75659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:33 devstack sudo[75659]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:33 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.489s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:33 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:33 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:33 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:33 devstack sudo[75913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:18:33 devstack sudo[75913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:34 devstack sudo[75913]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:34 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.749s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:34 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:34 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:34 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:34 devstack sudo[75961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 06 15:18:34 devstack sudo[75961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:34 devstack sudo[75961]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:34 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.755s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:34 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:34 devstack sudo[75965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 15:18:34 devstack sudo[75965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:35 devstack sudo[75965]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:35 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:35 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:35 devstack sudo[75968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 15:18:35 devstack sudo[75968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:36 devstack sudo[75968]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:36 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.794s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:36 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:36 devstack sudo[75980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:18:36 devstack sudo[75980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:37 devstack sudo[75980]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:37 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.783s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:37 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:37 devstack sudo[75987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:18:37 devstack sudo[75987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:37 devstack sudo[75987]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:37 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:37 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:37 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:37 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:37 devstack sudo[75995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:18:37 devstack sudo[75995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:38 devstack sudo[75995]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:38 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:38 devstack cinder-volume[75176]: INFO cinder.volume.drivers.lvm [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 06 15:18:38 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:38 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:38 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:38 devstack sudo[76001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:18:38 devstack sudo[76001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:39 devstack sudo[76001]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:39 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.820s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:39 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 15:18:39 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:39 devstack sudo[76093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 15:18:39 devstack sudo[76093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:39 devstack cinder-volume[75003]: DEBUG dbcounter [-] [75003] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75003) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:18:40 devstack sudo[76093]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:40 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:40 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:40 devstack sudo[76176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:18:40 devstack sudo[76176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:40 devstack sudo[76176]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:40 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:40 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:40 devstack sudo[76266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:18:40 devstack sudo[76266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:41 devstack sudo[76266]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:41 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:41 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:41 devstack sudo[76269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:18:41 devstack sudo[76269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:42 devstack sudo[76269]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:42 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:42 devstack cinder-volume[75176]: INFO cinder.volume.driver [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Driver hasn't implemented _init_vendor_properties()
Jul 06 15:18:42 devstack cinder-volume[75176]: DEBUG cinder.volume.driver [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75176) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 06 15:18:42 devstack cinder-volume[75176]: DEBUG oslo_db.sqlalchemy.engines [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75176) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:18:42 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writer thread running {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 15:18:42 devstack cinder-volume[75176]: DEBUG cinder.db.api [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Building query based on filter {{(pid=75176) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 06 15:18:42 devstack cinder-volume[75176]: DEBUG cinder.image.image_utils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75176) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 06 15:18:42 devstack cinder-volume[75176]: INFO cinder.keymgr.migration [None req-64d6f3f2-2dff-44cc-a8a7-868ced8f689f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 06 15:18:42 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 15:18:42 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:42 devstack sudo[76274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 15:18:42 devstack sudo[76274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:42 devstack sudo[76274]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:42 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:42 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:42 devstack sudo[76278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:18:42 devstack sudo[76278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:43 devstack sudo[76278]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:43 devstack sudo[76284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:18:43 devstack sudo[76284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:44 devstack sudo[76284]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:44 devstack sudo[76287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:18:44 devstack sudo[76287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:44 devstack sudo[76287]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:44 devstack cinder-volume[75176]: DEBUG cinder.manager [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Notifying Schedulers of capabilities ... {{(pid=75176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:18:44 devstack cinder-volume[75176]: INFO cinder.volume.manager [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Driver initialization completed successfully.
Jul 06 15:18:44 devstack cinder-volume[75176]: INFO cinder.manager [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Initiating service 2 cleanup
Jul 06 15:18:44 devstack cinder-volume[75176]: INFO cinder.manager [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Service 2 cleanup completed.
Jul 06 15:18:44 devstack cinder-volume[75176]: DEBUG cinder.service [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Creating RPC server for service cinder-volume {{(pid=75176) start /opt/stack/cinder/cinder/service.py:231}}
Jul 06 15:18:44 devstack cinder-volume[75176]: DEBUG cinder.service [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75176) start /opt/stack/cinder/cinder/service.py:237}}
Jul 06 15:18:45 devstack cinder-volume[75176]: INFO cinder.volume.manager [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 06 15:18:45 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 15:18:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:45 devstack sudo[76291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 15:18:45 devstack sudo[76291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:45 devstack sudo[76291]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:45 devstack sudo[76295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:18:45 devstack sudo[76295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:46 devstack sudo[76295]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:46 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:46 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:46 devstack sudo[76298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:18:46 devstack sudo[76298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:47 devstack sudo[76298]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:47 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:47 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:18:47 devstack sudo[76358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:18:47 devstack sudo[76358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:18:47 devstack sudo[76358]: pam_unix(sudo:session): session closed for user root
Jul 06 15:18:47 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:18:47 devstack cinder-volume[75176]: INFO cinder.volume.manager [None req-336bdeaa-2c93-4203-bf3c-3d94228d7797 None None] Driver post RPC initialization completed successfully.
Jul 06 15:18:54 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:SELECT=3 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:18:57 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:19:29 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:19:29 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 15:19:29 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:19:29 devstack sudo[77909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 15:19:29 devstack sudo[77909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:19:30 devstack sudo[77909]: pam_unix(sudo:session): session closed for user root
Jul 06 15:19:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:19:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:19:30 devstack sudo[77912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:19:30 devstack sudo[77912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:19:31 devstack sudo[77912]: pam_unix(sudo:session): session closed for user root
Jul 06 15:19:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:19:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:19:31 devstack sudo[77915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:19:31 devstack sudo[77915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:19:31 devstack sudo[77915]: pam_unix(sudo:session): session closed for user root
Jul 06 15:19:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:19:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:19:31 devstack sudo[77918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:19:31 devstack sudo[77918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:19:32 devstack sudo[77918]: pam_unix(sudo:session): session closed for user root
Jul 06 15:19:32 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:19:32 devstack cinder-volume[75176]: DEBUG cinder.manager [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Notifying Schedulers of capabilities ... {{(pid=75176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:19:32 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running periodic task VolumeManager._thread_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:19:32 devstack cinder-volume[75176]: DEBUG cinder.volume.manager [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] thread count: 6 {{(pid=75176) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:19:32 devstack cinder-volume[75176]: DEBUG cinder.volume.manager [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] thread info: [<_MainThread(MainThread, started 133584349122688)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133584242030784)>, <Thread(Thread-3 (stat_writer), started daemon 133584239145408)>, <Thread(Rabbit-heartbeat, started daemon 133584236696704)>, <Thread(Thread-5 (_runner), started daemon 133584237086336)>, <Thread(Thread-7 (_runner), started daemon 133584237168064)>] {{(pid=75176) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:20:29 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:20:29 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 15:20:29 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:20:29 devstack sudo[81282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 15:20:29 devstack sudo[81282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:20:30 devstack sudo[81282]: pam_unix(sudo:session): session closed for user root
Jul 06 15:20:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:20:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:20:30 devstack sudo[81285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:20:30 devstack sudo[81285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:20:30 devstack sudo[81285]: pam_unix(sudo:session): session closed for user root
Jul 06 15:20:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:20:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:20:30 devstack sudo[81288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:20:30 devstack sudo[81288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:20:31 devstack sudo[81288]: pam_unix(sudo:session): session closed for user root
Jul 06 15:20:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:20:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:20:31 devstack sudo[81291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:20:31 devstack sudo[81291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:20:32 devstack sudo[81291]: pam_unix(sudo:session): session closed for user root
Jul 06 15:20:32 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:20:32 devstack cinder-volume[75176]: DEBUG cinder.manager [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Notifying Schedulers of capabilities ... {{(pid=75176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:20:57 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:SELECT=1 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:20:57 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:UPDATE=1 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:21:29 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running periodic task VolumeManager._thread_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:21:29 devstack cinder-volume[75176]: DEBUG cinder.volume.manager [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] thread count: 6 {{(pid=75176) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:21:29 devstack cinder-volume[75176]: DEBUG cinder.volume.manager [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] thread info: [<_MainThread(MainThread, started 133584349122688)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133584242030784)>, <Thread(Thread-3 (stat_writer), started daemon 133584239145408)>, <Thread(Rabbit-heartbeat, started daemon 133584236696704)>, <Thread(Thread-5 (_runner), started daemon 133584237086336)>, <Thread(Thread-7 (_runner), started daemon 133584237168064)>] {{(pid=75176) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:22:29 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:22:29 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 15:22:29 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:22:29 devstack sudo[84346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 15:22:29 devstack sudo[84346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:22:30 devstack sudo[84346]: pam_unix(sudo:session): session closed for user root
Jul 06 15:22:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:22:30 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:22:30 devstack sudo[84360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:22:30 devstack sudo[84360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:22:31 devstack sudo[84360]: pam_unix(sudo:session): session closed for user root
Jul 06 15:22:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:22:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:22:31 devstack sudo[84386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 15:22:31 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:22:31 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root
Jul 06 15:22:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:22:31 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:22:31 devstack sudo[84392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 15:22:31 devstack sudo[84392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:22:32 devstack sudo[84392]: pam_unix(sudo:session): session closed for user root
Jul 06 15:22:32 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:22:32 devstack cinder-volume[75176]: DEBUG cinder.manager [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Notifying Schedulers of capabilities ... {{(pid=75176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:22:32 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] Running periodic task VolumeManager._thread_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:22:32 devstack cinder-volume[75176]: DEBUG cinder.volume.manager [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] thread count: 6 {{(pid=75176) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:22:32 devstack cinder-volume[75176]: DEBUG cinder.volume.manager [None req-7784aea7-3cba-4cc1-acb4-5c0d270f3187 None None] thread info: [<_MainThread(MainThread, started 133584349122688)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133584242030784)>, <Thread(Thread-3 (stat_writer), started daemon 133584239145408)>, <Thread(Rabbit-heartbeat, started daemon 133584236696704)>, <Thread(Thread-5 (_runner), started daemon 133584237086336)>, <Thread(Thread-7 (_runner), started daemon 133584237168064)>] {{(pid=75176) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:22:57 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:SELECT=1 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:22:57 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:UPDATE=1 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:23:09 devstack cinder-volume[75003]: INFO oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Caught SIGTERM, stopping children
Jul 06 15:23:09 devstack cinder-volume[75003]: DEBUG oslo_concurrency.lockutils [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Acquiring lock "singleton_lock" {{(pid=75003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 15:23:09 devstack cinder-volume[75003]: DEBUG oslo_concurrency.lockutils [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Acquired lock "singleton_lock" {{(pid=75003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 15:23:09 devstack cinder-volume[75003]: DEBUG oslo_concurrency.lockutils [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Releasing lock "singleton_lock" {{(pid=75003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 15:23:09 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Stop services. {{(pid=75003) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 06 15:23:09 devstack cinder-volume[75003]: DEBUG oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Killing children. {{(pid=75003) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 06 15:23:09 devstack cinder-volume[75003]: INFO oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Waiting on 1 children to exit
Jul 06 15:23:10 devstack cinder-volume[75176]: DEBUG oslo_concurrency.lockutils [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Acquiring lock "singleton_lock" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 15:23:10 devstack cinder-volume[75176]: DEBUG oslo_concurrency.lockutils [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Acquired lock "singleton_lock" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 15:23:10 devstack cinder-volume[75176]: DEBUG oslo_concurrency.lockutils [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Releasing lock "singleton_lock" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 15:23:10 devstack cinder-volume[75176]: WARNING amqp [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 15:23:10 devstack cinder-volume[75176]: WARNING amqp [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 15:23:10 devstack cinder-volume[75003]: INFO oslo_service.backend._eventlet.service [None req-29d91944-cfa8-49b2-9894-10c5189ade79 None None] Child 75176 exited with status 0
Jul 06 15:23:10 devstack cinder-volume[85288]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 06 15:23:10 devstack cinder-volume[85288]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 15:23:10 devstack cinder-volume[85288]: we strongly recommend against using it for new projects.
Jul 06 15:23:10 devstack cinder-volume[85288]: If you are already using Eventlet, we recommend migrating to a different
Jul 06 15:23:10 devstack cinder-volume[85288]: framework.  For more detail see
Jul 06 15:23:10 devstack cinder-volume[85288]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 15:23:10 devstack cinder-volume[85288]:   import eventlet  # noqa
Jul 06 15:23:12 devstack cinder-volume[85288]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 15:23:12 devstack cinder-volume[85288]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 15:23:12 devstack cinder-volume[85288]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 15:23:13 devstack cinder-volume[85288]: INFO dbcounter [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Registered counter for database cinder
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_db.sqlalchemy.engines [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85288) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG dbcounter [-] [85288] Writer thread running {{(pid=85288) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 15:23:13 devstack cinder-volume[85288]: INFO cinder.rpc [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 06 15:23:13 devstack cinder-volume[85288]: INFO cinder.rpc [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_db.sqlalchemy.engines [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85288) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:23:13 devstack cinder-volume[85288]: INFO cinder.volume.manager [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Determined volume DB was empty at startup.
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG cinder.volume.manager [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85288) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 06 15:23:13 devstack cinder-volume[85288]: INFO cinder.volume.manager [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 06 15:23:13 devstack cinder-volume[85288]: WARNING stevedore.named [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 15:23:13 devstack cinder-volume[85288]: WARNING castellan.key_manager [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 15:23:13 devstack cinder-volume[85288]: WARNING cinder.keymgr.conf_key_mgr [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 15:23:13 devstack cinder-volume[85288]: INFO cinder.volume.manager [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_db.sqlalchemy.engines [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85288) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:23:13 devstack cinder-volume[85288]: INFO oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Starting 1 workers
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Started child 85506 {{(pid=85288) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Full set of CONF: {{(pid=85288) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] ******************************************************************************** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Configuration options gathered from: {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] ================================================================================ {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] allow_availability_zone_fallback = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] allow_compression_on_image_upload = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] allowed_direct_url_schemes     = [] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] api_rate_limit                 = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] auth_strategy                  = keystone {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_availability_zone      = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85506]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_host                   = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_name                   = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_stats_polling_interval = 60 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backup_api_class               = cinder.backup.api.API {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backup_name_template           = backup-%s {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backup_use_same_host           = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backup_use_temp_snapshot       = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] chap_password                  = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] chap_username                  =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cinder_internal_tenant_project_id = c50676c35eb54f1c869cb4f5167b334d {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cinder_internal_tenant_user_id = 90c2658acd7b451f9ac9f683e3ecf63a {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cluster                        = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] compression_format             = gzip {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] config_dir                     = [] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] config_source                  = [] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] control_exchange               = openstack {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] debug                          = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] default_availability_zone      = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] default_group_type             = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] default_volume_type            = QuobyteHD {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] disk_geometry                  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] driver_client_cert             = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] driver_client_cert_key         = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] driver_data_namespace          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] driver_ssl_cert_path           = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] driver_ssl_cert_verify         = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] driver_use_ssl                 = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] enable_new_services            = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] enable_unsupported_driver      = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] enforce_multipath_for_image_xfer = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] filter_function                = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance_api_insecure            = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance_api_servers             = ['http://192.168.122.18/image'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance_api_ssl_compression     = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance_ca_certificates_file    = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance_certfile                = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance_keyfile                 = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance_num_retries             = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance_request_timeout         = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] goodness_function              = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] graceful_shutdown_timeout      = 5 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] group_api_class                = cinder.group.api.API {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] host                           = devstack {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] image_compress_on_upload       = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] image_conversion_address_space_limit = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] image_conversion_cpu_limit     = 60 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] image_conversion_disable       = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] image_upload_use_cinder_backend = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] image_upload_use_internal_tenant = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] image_volume_cache_enabled     = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] image_volume_cache_max_count   = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] image_volume_cache_max_size_gb = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] init_host_max_objects_retrieval = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] iscsi_target_flags             =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] iscsi_write_cache              = on {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] iser_helper                    = tgtadm {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] iser_ip_address                = 192.168.122.18 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] iser_port                      = 3260 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] log_color                      = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] log_config_append              = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] log_dir                        = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] log_file                       = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] log_options                    = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] log_rotate_interval            = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] log_rotate_interval_type       = days {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] log_rotation_type              = none {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85506]: INFO cinder.volume.manager [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] max_age                        = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.remotefs [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85506) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] max_logfile_count              = 30 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] max_logfile_size_mb            = 200 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] max_over_subscription_ratio    = 20.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] message_reap_interval          = 86400 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] message_ttl                    = 2592000 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] migration_create_volume_timeout_secs = 300 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] monkey_patch                   = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] monkey_patch_modules           = [] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] my_ip                          = 192.168.122.18 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] no_snapshot_gb_quota           = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] num_iser_scan_tries            = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] num_shell_tries                = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] num_volume_device_scan_tries   = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] nvmeof_conn_info_version       = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] nvmet_ns_id                    = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] nvmet_port_id                  = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] osapi_max_limit                = 1000 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] osapi_volume_ext_list          = [] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] osapi_volume_listen_port       = 8776 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] osapi_volume_use_ssl           = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] osapi_volume_workers           = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] per_volume_size_limit          = -1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] periodic_fuzzy_delay           = 60 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] periodic_interval              = 60 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] public_endpoint                = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] publish_errors                 = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] quota_backup_gigabytes         = 1000 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] quota_backups                  = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] quota_gigabytes                = 1000 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] quota_groups                   = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] quota_snapshots                = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] quota_volumes                  = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] rate_limit_burst               = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] rate_limit_except_level        = CRITICAL {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] rate_limit_interval            = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] reinit_driver_count            = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] replication_device             = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] report_discard_supported       = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] report_interval                = 120 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] reservation_clean_interval     = 86400 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] reservation_expire             = 86400 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] reserved_image_namespaces      = [] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] reserved_percentage            = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] rpc_response_timeout           = 120 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] run_external_periodic_tasks    = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] scst_target_driver             = iscsi {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] scst_target_iqn_name           = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_down_time              = 720 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] shell_completion               = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] snapshot_name_template         = snapshot-%s {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] split_loggers                  = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] state_path                     = /opt/stack/data/cinder {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] storage_availability_zone      = nova {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] storage_protocol               = iSCSI {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] syslog_log_facility            = LOG_USER {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] target_helper                  = lioadm {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] target_ip_address              = 192.168.122.18 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] target_port                    = 3260 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] target_protocol                = iscsi {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:13 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] target_secondary_ip_addresses  = [] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] trace_flags                    = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] transport_url                  = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] until_refresh                  = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] use_chap_auth                  = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] use_default_quota_class        = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] use_journal                    = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] use_json                       = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] use_multipath_for_image_xfer   = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] use_stderr                     = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] use_syslog                     = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] verify_glance_signatures       = enabled {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_api_class               = cinder.volume.api.API {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_backend_name            = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_clear                   = zero {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_clear_ionice            = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_clear_size              = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_copy_bps_limit          = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_dd_blocksize            = 1M {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_name_template           = volume-%s {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_service_inithost_offload = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volume_usage_audit_period      = month {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] zoning_mode                    = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_concurrency.disable_process_locking = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.auth_section = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.auth_type   = password {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.auth_version = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.cache       = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.certfile    = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.include_service_catalog = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.insecure    = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.interface   = public {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.keyfile     = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_password =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcache_username =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.region_name = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.service_type = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.18/identity {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.backend                  = dogpile.cache.null {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.backend_argument         = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.backend_expiration_time  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.config_prefix            = cache.oslo {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.debug_cache_backend      = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.enable_retry_client      = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.enable_socket_keepalive  = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.enabled                  = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.expiration_time          = 600 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.hashclient_retry_attempts = 2 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.memcache_dead_retry      = 300 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.memcache_sasl_enabled    = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.password                 = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.proxies                  = [] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.redis_db                 = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.redis_server             = localhost:6379 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.retry_attempts           = 2 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.retry_delay              = 0.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.socket_keepalive_count   = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.socket_keepalive_idle    = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.socket_keepalive_interval = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.socket_timeout           = 1.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.tls_allowed_ciphers      = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.tls_cafile               = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.tls_certfile             = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.tls_enabled              = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.tls_keyfile              = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cache.username                 = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] coordination.backend_url       = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.asyncio_connection    = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.asyncio_slave_connection = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.backend               = sqlalchemy {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.connection            = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.connection_debug      = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.connection_parameters =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.connection_recycle_time = 3600 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.connection_trace      = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.db_inc_retry_interval = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.db_max_retries        = 20 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.db_max_retry_interval = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.db_retry_interval     = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.max_overflow          = 50 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.max_pool_size         = 5 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.max_retries           = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.mysql_wsrep_sync_wait = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.pool_timeout          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.retry_interval        = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.slave_connection      = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.sqlite_synchronous    = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.synchronous_reader    = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] database.use_db_reconnect      = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.connection_string     = messaging:// {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.enabled               = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.es_doc_type           = notification {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.es_scroll_size        = 10000 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.es_scroll_time        = 2m {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.filter_error_trace    = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85506) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.hmac_keys             = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.sentinel_service_name = mymaster {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.socket_timeout        = 0.1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.trace_requests        = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler.trace_sqlalchemy      = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler_jaeger.process_tags   = {} {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler_jaeger.service_name_prefix = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] profiler_otlp.service_name_prefix = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.enforce_new_defaults = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85506]: WARNING cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 06 15:23:14 devstack cinder-volume[85506]: WARNING cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.enforce_scope      = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.policy_default_rule = default {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Running cmd (subprocess): mount.quobyte {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] privsep_osbrick.group          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] privsep_osbrick.helper_command = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] privsep_osbrick.user           = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cinder_sys_admin.group         = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cinder_sys_admin.helper_command = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] cinder_sys_admin.user          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_user.auth_section      = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_user.auth_type         = password {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_user.cafile            = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_user.certfile          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_user.collect_timing    = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_user.insecure          = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_user.keyfile           = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_user.send_service_user_token = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_user.split_loggers     = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] service_user.timeout           = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance.auth_section            = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance.auth_type               = password {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance.certfile                = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance.collect_timing          = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance.insecure                = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance.keyfile                 = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance.region_name             = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance.split_loggers           = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] glance.timeout                 = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.backend_availability_zone = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.chap_password = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.chap_username =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.disk_geometry = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.driver_client_cert = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.driver_client_cert_key = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.driver_data_namespace = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.driver_use_ssl = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.extra_capabilities = {} {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.filter_function = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.goodness_function = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.iscsi_target_flags =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.iscsi_write_cache = on {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.iser_ip_address = 192.168.122.18 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.iser_port     = 3260 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nas_host      =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nas_login     = admin {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nas_mount_options = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nas_password  = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nas_private_key =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nas_share_path =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.num_shell_tries = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.quobyte_volume_url = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.replication_device = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.report_discard_supported = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.reserved_percentage = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.target_helper = tgtadm {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.target_ip_address = 192.168.122.18 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.target_port   = 3260 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.target_protocol = iscsi {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.trace_flags   = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.unique_fqdn_network = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.use_chap_auth = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.volume_backend_name = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.volume_clear  = zero {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.volume_clear_ionice = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.volume_clear_size = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_reports.file_event_handler = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_reports.log_dir           = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.backend_availability_zone = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.backend_host         = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.chap_password        = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.chap_username        = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.disk_geometry        = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.driver_client_cert   = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.driver_data_namespace = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.extra_capabilities   = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.filter_function      = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.goodness_function    = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.iser_helper          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.iser_ip_address      = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.iser_port            = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nas_host             = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nas_login            = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nas_mount_options    = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nas_password         = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nas_private_key      = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nas_share_path       = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.num_shell_tries      = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.replication_device   = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.report_discard_supported = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.reserved_percentage  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.scst_target_driver   = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.storage_protocol     = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.target_helper        = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.target_ip_address    = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.target_port          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.target_prefix        = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.target_protocol      = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.trace_flags          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.use_chap_auth        = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.volume_clear         = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.volume_clear_size    = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] QuobyteHD.volumes_dir          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_notifications.driver = [] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_notifications.retry = -1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] key_manager.fixed_key          = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.barbican_api_version  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.barbican_endpoint     = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.barbican_endpoint_type = public {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.barbican_region_name  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.cafile                = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.certfile              = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.collect_timing        = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.insecure              = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.keyfile               = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.number_of_retries     = 60 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.retry_delay           = 1 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.send_service_user_token = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.split_loggers         = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.timeout               = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.verify_ssl            = True {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican.verify_ssl_path       = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican_service_user.auth_section = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican_service_user.auth_type = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican_service_user.cafile   = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican_service_user.certfile = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican_service_user.collect_timing = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican_service_user.insecure = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican_service_user.keyfile  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican_service_user.split_loggers = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] barbican_service_user.timeout  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.approle_role_id          = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.approle_secret_id        = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.kv_mountpoint            = secret {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.kv_path                  = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.kv_version               = 2 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.namespace                = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.root_token_id            = **** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.ssl_ca_crt_file          = None {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.timeout                  = 60.0 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.use_ssl                  = False {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:14 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] ******************************************************************************** {{(pid=85288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 06 15:23:14 devstack quobyte-client[85509]: Reading configuration file: /etc/quobyte/client.cfg
Jul 06 15:23:14 devstack quobyte-client[85509]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 06 15:23:14 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] CMD "mount.quobyte" returned: 1 in 0.141s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:23:14 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:23:14 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:23:14 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=85506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:23:14 devstack cinder-volume[85506]: INFO cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc ...
Jul 06 15:23:14 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 -c /etc/quobyte/client-cinder.cfg {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:23:14 devstack sudo[85512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 -c /etc/quobyte/client-cinder.cfg
Jul 06 15:23:14 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:23:15 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.799s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:23:15 devstack cinder-volume[85506]: INFO cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc succeeded
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=85506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.812s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:23:15 devstack sudo[85584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:23:15 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:23:15 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.718s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:23:15 devstack cinder-volume[85506]: INFO cinder.volume.driver [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Driver hasn't implemented _init_vendor_properties()
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG cinder.volume.driver [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85506) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG oslo_db.sqlalchemy.engines [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG dbcounter [-] [85506] Writer thread running {{(pid=85506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG cinder.db.api [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Building query based on filter {{(pid=85506) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG cinder.image.image_utils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85506) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 06 15:23:15 devstack cinder-volume[85506]: INFO cinder.keymgr.migration [None req-18378c13-157a-4165-b631-f9660f6e73e6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=85506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=85506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:23:15 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:23:16 devstack sudo[85604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:23:16 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:23:17 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root
Jul 06 15:23:17 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.159s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:23:17 devstack cinder-volume[85506]: DEBUG cinder.manager [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Notifying Schedulers of capabilities ... {{(pid=85506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:23:17 devstack cinder-volume[85506]: INFO cinder.volume.manager [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Driver initialization completed successfully.
Jul 06 15:23:17 devstack cinder-volume[85506]: INFO cinder.manager [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Initiating service 3 cleanup
Jul 06 15:23:17 devstack cinder-volume[85506]: INFO cinder.manager [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Service 3 cleanup completed.
Jul 06 15:23:17 devstack cinder-volume[85506]: DEBUG cinder.service [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Creating RPC server for service cinder-volume {{(pid=85506) start /opt/stack/cinder/cinder/service.py:231}}
Jul 06 15:23:17 devstack cinder-volume[85506]: DEBUG cinder.service [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85506) start /opt/stack/cinder/cinder/service.py:237}}
Jul 06 15:23:17 devstack cinder-volume[85506]: INFO cinder.volume.manager [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 06 15:23:17 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:23:17 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:23:17 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=85506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:23:17 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=85506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:23:17 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:23:17 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:23:17 devstack sudo[85724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:23:17 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:23:18 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root
Jul 06 15:23:18 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.859s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:23:18 devstack cinder-volume[85506]: INFO cinder.volume.manager [None req-e50722c7-e52c-4cc8-97ae-b6802ba89250 None None] Driver post RPC initialization completed successfully.
Jul 06 15:23:20 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-bb72b610-32a1-4a5b-8888-b1312e777293 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:23:20 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-bb72b610-32a1-4a5b-8888-b1312e777293 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:23:20 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-bb72b610-32a1-4a5b-8888-b1312e777293 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=85506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:23:20 devstack cinder-volume[85506]: DEBUG cinder.volume.drivers.quobyte [None req-bb72b610-32a1-4a5b-8888-b1312e777293 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=85506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:23:20 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-bb72b610-32a1-4a5b-8888-b1312e777293 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:23:20 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-bb72b610-32a1-4a5b-8888-b1312e777293 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:23:20 devstack sudo[85791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:23:20 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:23:21 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root
Jul 06 15:23:21 devstack cinder-volume[85506]: DEBUG oslo_concurrency.processutils [None req-bb72b610-32a1-4a5b-8888-b1312e777293 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.590s {{(pid=85506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:23:21 devstack cinder-volume[85506]: DEBUG cinder.manager [None req-bb72b610-32a1-4a5b-8888-b1312e777293 None None] Notifying Schedulers of capabilities ... {{(pid=85506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:23:23 devstack cinder-volume[85288]: INFO oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Caught SIGTERM, stopping children
Jul 06 15:23:23 devstack cinder-volume[85288]: DEBUG oslo_concurrency.lockutils [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Acquiring lock "singleton_lock" {{(pid=85288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 15:23:23 devstack cinder-volume[85288]: DEBUG oslo_concurrency.lockutils [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Acquired lock "singleton_lock" {{(pid=85288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 15:23:23 devstack cinder-volume[85288]: DEBUG oslo_concurrency.lockutils [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Releasing lock "singleton_lock" {{(pid=85288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 15:23:23 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Stop services. {{(pid=85288) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 06 15:23:23 devstack cinder-volume[85288]: DEBUG oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Killing children. {{(pid=85288) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 06 15:23:23 devstack cinder-volume[85288]: INFO oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Waiting on 1 children to exit
Jul 06 15:23:25 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Acquiring lock "singleton_lock" {{(pid=85506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 15:23:25 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Acquired lock "singleton_lock" {{(pid=85506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 15:23:25 devstack cinder-volume[85506]: DEBUG oslo_concurrency.lockutils [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Releasing lock "singleton_lock" {{(pid=85506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 15:23:25 devstack cinder-volume[85506]: WARNING amqp [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 15:23:25 devstack cinder-volume[85288]: INFO oslo_service.backend._eventlet.service [None req-3b2b9be3-5c9d-432d-b763-f414a7f41bd1 None None] Child 85506 exited with status 0
Jul 06 15:23:26 devstack cinder-volume[85964]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 06 15:23:26 devstack cinder-volume[85964]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 15:23:26 devstack cinder-volume[85964]: we strongly recommend against using it for new projects.
Jul 06 15:23:26 devstack cinder-volume[85964]: If you are already using Eventlet, we recommend migrating to a different
Jul 06 15:23:26 devstack cinder-volume[85964]: framework.  For more detail see
Jul 06 15:23:26 devstack cinder-volume[85964]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 15:23:26 devstack cinder-volume[85964]:   import eventlet  # noqa
Jul 06 15:23:29 devstack cinder-volume[85964]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85964) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 15:23:29 devstack cinder-volume[85964]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85964) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 15:23:29 devstack cinder-volume[85964]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85964) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 15:23:29 devstack cinder-volume[85964]: INFO dbcounter [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Registered counter for database cinder
Jul 06 15:23:29 devstack cinder-volume[85964]: DEBUG oslo_db.sqlalchemy.engines [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85964) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:23:30 devstack cinder-volume[85964]: DEBUG dbcounter [-] [85964] Writer thread running {{(pid=85964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 15:23:30 devstack cinder-volume[85964]: INFO cinder.rpc [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 06 15:23:30 devstack cinder-volume[85964]: INFO cinder.rpc [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 06 15:23:30 devstack cinder-volume[85964]: DEBUG oslo_db.sqlalchemy.engines [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85964) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:23:30 devstack cinder-volume[85964]: INFO cinder.volume.manager [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Determined volume DB was empty at startup.
Jul 06 15:23:30 devstack cinder-volume[85964]: DEBUG cinder.volume.manager [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85964) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 06 15:23:30 devstack cinder-volume[85964]: WARNING stevedore.named [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 15:23:30 devstack cinder-volume[85964]: WARNING castellan.key_manager [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 15:23:30 devstack cinder-volume[85964]: WARNING cinder.keymgr.conf_key_mgr [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 15:23:30 devstack cinder-volume[85964]: INFO cinder.volume.manager [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_db.sqlalchemy.engines [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85964) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:23:31 devstack cinder-volume[85964]: INFO oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Starting 1 workers
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Started child 86249 {{(pid=85964) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Full set of CONF: {{(pid=85964) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] ******************************************************************************** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] Configuration options gathered from: {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 06 15:23:31 devstack cinder-volume[86249]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] ================================================================================ {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] allow_availability_zone_fallback = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] allow_compression_on_image_upload = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] allowed_direct_url_schemes     = [] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] api_rate_limit                 = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] auth_strategy                  = keystone {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_availability_zone      = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_host                   = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_name                   = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_stats_polling_interval = 60 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backup_api_class               = cinder.backup.api.API {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backup_name_template           = backup-%s {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backup_use_same_host           = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backup_use_temp_snapshot       = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] chap_password                  = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] chap_username                  =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cinder_internal_tenant_project_id = c50676c35eb54f1c869cb4f5167b334d {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cinder_internal_tenant_user_id = 90c2658acd7b451f9ac9f683e3ecf63a {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cluster                        = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] compression_format             = gzip {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] config_dir                     = [] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] config_source                  = [] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] control_exchange               = openstack {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] debug                          = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] default_availability_zone      = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] default_group_type             = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] default_volume_type            = QuobyteHD {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] disk_geometry                  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] driver_client_cert             = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] driver_client_cert_key         = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] driver_data_namespace          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] driver_ssl_cert_path           = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] driver_ssl_cert_verify         = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] driver_use_ssl                 = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] enable_new_services            = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] enable_unsupported_driver      = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] enforce_multipath_for_image_xfer = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] filter_function                = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance_api_insecure            = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance_api_servers             = ['http://192.168.122.18/image'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance_api_ssl_compression     = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance_ca_certificates_file    = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance_certfile                = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance_keyfile                 = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance_num_retries             = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance_request_timeout         = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 06 15:23:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86249) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] goodness_function              = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] graceful_shutdown_timeout      = 5 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] group_api_class                = cinder.group.api.API {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] host                           = devstack {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] image_compress_on_upload       = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] image_conversion_address_space_limit = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] image_conversion_cpu_limit     = 60 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] image_conversion_disable       = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] image_upload_use_cinder_backend = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] image_upload_use_internal_tenant = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] image_volume_cache_enabled     = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] image_volume_cache_max_count   = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] image_volume_cache_max_size_gb = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] init_host_max_objects_retrieval = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] iscsi_target_flags             =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] iscsi_write_cache              = on {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] iser_helper                    = tgtadm {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] iser_ip_address                = 192.168.122.18 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] iser_port                      = 3260 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] log_color                      = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] log_config_append              = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] log_dir                        = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] log_file                       = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] log_options                    = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] log_rotate_interval            = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] log_rotate_interval_type       = days {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] log_rotation_type              = none {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] max_age                        = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] max_logfile_count              = 30 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] max_logfile_size_mb            = 200 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] max_over_subscription_ratio    = 20.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] message_reap_interval          = 86400 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] message_ttl                    = 2592000 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] migration_create_volume_timeout_secs = 300 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] monkey_patch                   = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] monkey_patch_modules           = [] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] my_ip                          = 192.168.122.18 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] no_snapshot_gb_quota           = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] num_iser_scan_tries            = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] num_shell_tries                = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] num_volume_device_scan_tries   = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] nvmeof_conn_info_version       = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] nvmet_ns_id                    = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] nvmet_port_id                  = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack sudo[86252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] osapi_max_limit                = 1000 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] osapi_volume_ext_list          = [] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] osapi_volume_listen_port       = 8776 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] osapi_volume_use_ssl           = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] osapi_volume_workers           = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] per_volume_size_limit          = -1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] periodic_fuzzy_delay           = 60 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] periodic_interval              = 60 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] public_endpoint                = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] publish_errors                 = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] quota_backup_gigabytes         = 1000 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] quota_backups                  = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] quota_gigabytes                = 1000 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] quota_groups                   = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] quota_snapshots                = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] quota_volumes                  = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] rate_limit_burst               = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] rate_limit_except_level        = CRITICAL {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] rate_limit_interval            = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] reinit_driver_count            = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] replication_device             = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] report_discard_supported       = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] report_interval                = 120 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] reservation_clean_interval     = 86400 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] reservation_expire             = 86400 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] reserved_image_namespaces      = [] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] reserved_percentage            = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] rpc_response_timeout           = 120 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] run_external_periodic_tasks    = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] scst_target_driver             = iscsi {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] scst_target_iqn_name           = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_down_time              = 720 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] shell_completion               = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] snapshot_name_template         = snapshot-%s {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] split_loggers                  = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] state_path                     = /opt/stack/data/cinder {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] storage_availability_zone      = nova {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] storage_protocol               = iSCSI {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] syslog_log_facility            = LOG_USER {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] target_helper                  = lioadm {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] target_ip_address              = 192.168.122.18 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] target_port                    = 3260 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] target_protocol                = iscsi {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] target_secondary_ip_addresses  = [] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] trace_flags                    = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] transport_url                  = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] until_refresh                  = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] use_chap_auth                  = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] use_default_quota_class        = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] use_journal                    = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] use_json                       = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] use_multipath_for_image_xfer   = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] use_stderr                     = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] use_syslog                     = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] verify_glance_signatures       = enabled {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_api_class               = cinder.volume.api.API {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_backend_name            = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_clear                   = zero {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_clear_ionice            = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_clear_size              = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_copy_bps_limit          = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_dd_blocksize            = 1M {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_name_template           = volume-%s {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_service_inithost_offload = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volume_usage_audit_period      = month {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] zoning_mode                    = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_concurrency.disable_process_locking = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.auth_section = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.auth_type   = password {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.auth_version = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.cache       = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.certfile    = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.include_service_catalog = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.insecure    = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.interface   = public {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.keyfile     = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_password =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcache_username =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.region_name = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.service_type = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.18/identity {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.backend                  = dogpile.cache.null {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.backend_argument         = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.backend_expiration_time  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.config_prefix            = cache.oslo {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.debug_cache_backend      = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.enable_retry_client      = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.enable_socket_keepalive  = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.enabled                  = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.expiration_time          = 600 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.hashclient_retry_attempts = 2 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.memcache_dead_retry      = 300 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.memcache_sasl_enabled    = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.password                 = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.proxies                  = [] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.redis_db                 = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.redis_server             = localhost:6379 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.retry_attempts           = 2 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.retry_delay              = 0.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.socket_keepalive_count   = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.socket_keepalive_idle    = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.socket_keepalive_interval = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.socket_timeout           = 1.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.tls_allowed_ciphers      = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.tls_cafile               = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.tls_certfile             = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.tls_enabled              = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.tls_keyfile              = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cache.username                 = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] coordination.backend_url       = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.asyncio_connection    = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.asyncio_slave_connection = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.backend               = sqlalchemy {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.connection            = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.connection_debug      = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.connection_parameters =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.connection_recycle_time = 3600 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.connection_trace      = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.db_inc_retry_interval = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.db_max_retries        = 20 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.db_max_retry_interval = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.db_retry_interval     = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.max_overflow          = 50 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.max_pool_size         = 5 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.max_retries           = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.mysql_wsrep_sync_wait = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.pool_timeout          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.retry_interval        = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.slave_connection      = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.sqlite_synchronous    = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.synchronous_reader    = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] database.use_db_reconnect      = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.connection_string     = messaging:// {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.enabled               = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.es_doc_type           = notification {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.es_scroll_size        = 10000 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.es_scroll_time        = 2m {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.filter_error_trace    = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.hmac_keys             = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.sentinel_service_name = mymaster {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.socket_timeout        = 0.1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.trace_requests        = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler.trace_sqlalchemy      = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler_jaeger.process_tags   = {} {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler_jaeger.service_name_prefix = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] profiler_otlp.service_name_prefix = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.enforce_new_defaults = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.enforce_scope      = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.policy_default_rule = default {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] privsep_osbrick.group          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] privsep_osbrick.helper_command = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86249) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 06 15:23:31 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.quobyte [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] privsep_osbrick.user           = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cinder_sys_admin.group         = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cinder_sys_admin.helper_command = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] cinder_sys_admin.user          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_user.auth_section      = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_user.auth_type         = password {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_user.cafile            = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_user.certfile          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_user.collect_timing    = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_user.insecure          = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_user.keyfile           = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_user.send_service_user_token = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_user.split_loggers     = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] service_user.timeout           = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.quobyte [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 06 15:23:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance.auth_section            = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance.auth_type               = password {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance.certfile                = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance.collect_timing          = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance.insecure                = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance.keyfile                 = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance.region_name             = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance.split_loggers           = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] glance.timeout                 = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.backend_availability_zone = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.chap_password = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.chap_username =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.disk_geometry = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.driver_client_cert = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.driver_client_cert_key = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.driver_data_namespace = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.driver_use_ssl = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.extra_capabilities = {} {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.filter_function = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.goodness_function = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.iscsi_target_flags =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.iscsi_write_cache = on {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.iser_ip_address = 192.168.122.18 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.iser_port     = 3260 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nas_host      =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nas_login     = admin {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nas_mount_options = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nas_password  = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nas_private_key =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nas_share_path =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.num_shell_tries = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.quobyte_volume_url = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.replication_device = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.report_discard_supported = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.reserved_percentage = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.target_helper = tgtadm {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.target_ip_address = 192.168.122.18 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.target_port   = 3260 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.target_protocol = iscsi {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.trace_flags   = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.unique_fqdn_network = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.use_chap_auth = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.volume_backend_name = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.volume_clear  = zero {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.volume_clear_ionice = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.volume_clear_size = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_reports.file_event_handler = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_reports.log_dir           = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.backend_availability_zone = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.backend_host         = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.chap_password        = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.chap_username        = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.disk_geometry        = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.driver_client_cert   = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.driver_data_namespace = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.extra_capabilities   = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.filter_function      = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.goodness_function    = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.iser_helper          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.iser_ip_address      = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.iser_port            = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nas_host             = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nas_login            = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nas_mount_options    = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nas_password         = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nas_private_key      = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nas_share_path       = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.num_shell_tries      = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.replication_device   = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.report_discard_supported = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.reserved_percentage  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.scst_target_driver   = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.storage_protocol     = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.target_helper        = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.target_ip_address    = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.target_port          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.target_prefix        = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.target_protocol      = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.trace_flags          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.use_chap_auth        = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.volume_clear         = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.volume_clear_size    = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] QuobyteHD.volumes_dir          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_notifications.driver = [] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_notifications.retry = -1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] key_manager.fixed_key          = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.barbican_api_version  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.barbican_endpoint     = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.barbican_endpoint_type = public {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.barbican_region_name  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.cafile                = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.certfile              = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.collect_timing        = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.insecure              = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.keyfile               = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.number_of_retries     = 60 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.retry_delay           = 1 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.send_service_user_token = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.split_loggers         = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.timeout               = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.verify_ssl            = True {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican.verify_ssl_path       = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican_service_user.auth_section = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican_service_user.auth_type = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican_service_user.cafile   = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican_service_user.certfile = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican_service_user.collect_timing = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican_service_user.insecure = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican_service_user.keyfile  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican_service_user.split_loggers = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] barbican_service_user.timeout  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.approle_role_id          = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.approle_secret_id        = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.kv_mountpoint            = secret {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.kv_path                  = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.kv_version               = 2 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.namespace                = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.root_token_id            = **** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.ssl_ca_crt_file          = None {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.timeout                  = 60.0 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.use_ssl                  = False {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 15:23:31 devstack cinder-volume[85964]: DEBUG oslo_service.backend._eventlet.service [None req-ab678ef2-f460-4a7b-a3a2-e826a96a4ab9 None None] ******************************************************************************** {{(pid=85964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 06 15:23:32 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.692s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:23:32 devstack cinder-volume[86249]: INFO cinder.volume.driver [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Driver hasn't implemented _init_vendor_properties()
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG cinder.volume.driver [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86249) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG oslo_db.sqlalchemy.engines [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86249) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writer thread running {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG cinder.db.api [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Building query based on filter {{(pid=86249) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86249) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:23:32 devstack cinder-volume[86249]: INFO cinder.keymgr.migration [None req-bc9cf2b9-e00d-4532-a632-231c94bec589 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 06 15:23:32 devstack sudo[86258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:23:32 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:23:32 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.674s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:23:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Driver initialization completed successfully.
Jul 06 15:23:32 devstack cinder-volume[86249]: INFO cinder.manager [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Initiating service 3 cleanup
Jul 06 15:23:32 devstack cinder-volume[86249]: INFO cinder.manager [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Service 3 cleanup completed.
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG cinder.service [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Creating RPC server for service cinder-volume {{(pid=86249) start /opt/stack/cinder/cinder/service.py:231}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG cinder.service [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86249) start /opt/stack/cinder/cinder/service.py:237}}
Jul 06 15:23:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:23:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:23:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:23:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:23:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:23:33 devstack sudo[86262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:23:33 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:23:33 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root
Jul 06 15:23:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.615s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:23:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6df7d431-0230-406d-9be3-32c76930a1a4 None None] Driver post RPC initialization completed successfully.
Jul 06 15:23:41 devstack cinder-volume[85964]: DEBUG dbcounter [-] [85964] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:23:42 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=2 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:23:43 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:24:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:24:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 6 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:24:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:24:31 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:24:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Flow 'volume_create_manager' (d97a31d3-e65c-4bb1-ad1a-0fd61bb50726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:24:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b3f9af-5485-4faf-803f-66bddc243c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b3f9af-5485-4faf-803f-66bddc243c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1695104786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6608b1-9a63-443d-ab0e-cd2465173b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab7ef2d08a7466f841f4299fc23bca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:32Z,use_quota=True,user_id='f7a23c1adbcc4a1a944cdcc31c13536d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b919936f-8da1-469e-974e-c952a94eb02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b919936f-8da1-469e-974e-c952a94eb02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba38d37-ca85-4ee1-82c0-b1193b8c7562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba38d37-ca85-4ee1-82c0-b1193b8c7562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6608b1-9a63-443d-ab0e-cd2465173b7d', 'volume_name': 'volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9146177-d7f7-4cea-87da-2914626653ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9146177-d7f7-4cea-87da-2914626653ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf281f8-79ad-4e2b-abfa-a8cdd1c84d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:32 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Volume 2e6608b1-9a63-443d-ab0e-cd2465173b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d', 'volume_size': 1}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1695104786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6608b1-9a63-443d-ab0e-cd2465173b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab7ef2d08a7466f841f4299fc23bca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:32Z,use_quota=True,user_id='f7a23c1adbcc4a1a944cdcc31c13536d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Creating volume 2e6608b1-9a63-443d-ab0e-cd2465173b7d {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:24:32 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:24:32 devstack sudo[86384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d 1073741824
Jul 06 15:24:32 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Flow 'volume_create_manager' (c8d60a33-87f3-440c-98e7-bb50c1742f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c79646-3d35-4cec-903f-b6547210e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c79646-3d35-4cec-903f-b6547210e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-945426428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68a45ca-ebeb-4937-951e-e892479dec5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f5f3229144c44e28375f5bd6a3b88a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:32Z,use_quota=True,user_id='6293c5a36d284402b2e3adb732f3a2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3014bad3-cb9e-4299-8cad-49c7d64ce359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3014bad3-cb9e-4299-8cad-49c7d64ce359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8236aa31-b382-49c2-a145-da7b478a131a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8236aa31-b382-49c2-a145-da7b478a131a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68a45ca-ebeb-4937-951e-e892479dec5e', 'volume_name': 'volume-c68a45ca-ebeb-4937-951e-e892479dec5e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42922cdf-fa0f-494c-b3c6-971e69a1c7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42922cdf-fa0f-494c-b3c6-971e69a1c7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2177d50c-abea-40ee-b90d-fe1c8c52eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:32 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Volume c68a45ca-ebeb-4937-951e-e892479dec5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68a45ca-ebeb-4937-951e-e892479dec5e', 'volume_size': 1}
Jul 06 15:24:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:24:33 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root
Jul 06 15:24:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d 1073741824" returned: 0 in 1.094s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:24:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:24:33 devstack sudo[86716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d
Jul 06 15:24:33 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:24:34 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d" returned: 0 in 0.905s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.908s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-945426428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68a45ca-ebeb-4937-951e-e892479dec5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f5f3229144c44e28375f5bd6a3b88a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:32Z,use_quota=True,user_id='6293c5a36d284402b2e3adb732f3a2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Creating volume c68a45ca-ebeb-4937-951e-e892479dec5e {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:24:34 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf281f8-79ad-4e2b-abfa-a8cdd1c84d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:34 devstack sudo[86734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e 1073741824
Jul 06 15:24:34 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761af32c-ef11-4327-bd18-e0b13a54c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:34 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Volume volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d (2e6608b1-9a63-443d-ab0e-cd2465173b7d): created successfully
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761af32c-ef11-4327-bd18-e0b13a54c451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Flow 'volume_create_manager' (d97a31d3-e65c-4bb1-ad1a-0fd61bb50726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:24:34 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f223fded-77a0-41c9-8d82-0a37a0ade4c8 tempest-TaggedAttachmentsTest-298552033 None] Created volume successfully.
Jul 06 15:24:35 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root
Jul 06 15:24:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e 1073741824" returned: 0 in 1.117s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:24:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:24:35 devstack sudo[86745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e
Jul 06 15:24:35 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:24:36 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root
Jul 06 15:24:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e" returned: 0 in 1.003s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:24:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:24:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:24:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2177d50c-abea-40ee-b90d-fe1c8c52eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68a45ca-ebeb-4937-951e-e892479dec5e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46ccae1-8bc9-4279-bdc7-8ace81cd17d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:36 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Volume volume-c68a45ca-ebeb-4937-951e-e892479dec5e (c68a45ca-ebeb-4937-951e-e892479dec5e): created successfully
Jul 06 15:24:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46ccae1-8bc9-4279-bdc7-8ace81cd17d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Flow 'volume_create_manager' (c8d60a33-87f3-440c-98e7-bb50c1742f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:24:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-322130a2-d452-45d6-8a70-127a6739922c req-46b63ae8-dd2c-4bdf-8f32-2c4c04b9fb42 tempest-VolumesGetTestJSON-1158080354 None] Created volume successfully.
Jul 06 15:24:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Acquiring lock "cinder-c68a45ca-ebeb-4937-951e-e892479dec5e-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:24:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Lock "cinder-c68a45ca-ebeb-4937-951e-e892479dec5e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:24:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Acquiring lock "cinder-quobyte-c68a45ca-ebeb-4937-951e-e892479dec5e" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:24:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Lock "cinder-quobyte-c68a45ca-ebeb-4937-951e-e892479dec5e" acquired by "delete_volume" :: waited 0.059s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:24:37 devstack cinder-volume[86249]: INFO oslo.privsep.daemon [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpoajzl66e/privsep.sock']
Jul 06 15:24:37 devstack sudo[86755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpoajzl66e/privsep.sock
Jul 06 15:24:37 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:24:38 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 06 15:24:38 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 15:24:38 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 06 15:24:38 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 15:24:38 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 06 15:24:38 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 06 15:24:38 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 15:24:38 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 15:24:38 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 06 15:24:39 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 06 15:24:39 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 15:24:39 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 06 15:24:39 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 15:24:39 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 06 15:24:39 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 06 15:24:39 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 15:24:39 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 15:24:39 devstack cinder-volume[86249]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 06 15:24:39 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root
Jul 06 15:24:39 devstack cinder-volume[86249]: INFO oslo.privsep.daemon [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Spawned new privsep daemon via rootwrap
Jul 06 15:24:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Accepted privsep connection to /tmp/tmpoajzl66e/privsep.sock {{(pid=86249) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 06 15:24:39 devstack cinder-volume[86249]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 06 15:24:39 devstack cinder-volume[86249]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 06 15:24:39 devstack cinder-volume[86249]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 06 15:24:39 devstack cinder-volume[86249]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86765
Jul 06 15:24:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df6e845-286f-4bbb-8f6d-93ef5a69f7b5]: (2,) {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:24:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0e38d8-005b-4807-8f28-4b3445a35032]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:24:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:24:39 devstack sudo[86767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e
Jul 06 15:24:39 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:24:40 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root
Jul 06 15:24:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e" returned: 0 in 1.332s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:24:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:24:40 devstack sudo[86789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e
Jul 06 15:24:40 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:24:41 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root
Jul 06 15:24:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c68a45ca-ebeb-4937-951e-e892479dec5e" returned: 0 in 0.896s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:24:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Lock "cinder-quobyte-c68a45ca-ebeb-4937-951e-e892479dec5e" released by "delete_volume" :: held 4.053s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:24:41 devstack cinder-volume[86249]: WARNING cinder.quota [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:24:41 devstack cinder-volume[86249]: WARNING cinder.quota [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:24:42 devstack cinder-volume[86249]: DEBUG cinder.quota [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Created reservations ['36f82d59-9840-481c-8426-2d93e41eea92', 'e95fa96d-49f5-48ab-8ccd-dc450758c0f7', '733beade-de66-4fa3-aa54-1e961e7d26c3', '86676ceb-8c68-4383-bc0e-9ab0da1afc9d'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:24:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:24:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:24:42 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:24:42 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:24:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:24:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:24:42 devstack sudo[86805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:24:42 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:24:43 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root
Jul 06 15:24:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.236s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:24:43 devstack cinder-volume[86249]: DEBUG cinder.manager [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:24:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Deleted volume successfully.
Jul 06 15:24:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-09fd13dd-5986-4520-b45b-89e7519874ef req-e10007ff-df25-474b-8245-b27e7714d5f5 tempest-VolumesGetTestJSON-1158080354 None] Lock "cinder-c68a45ca-ebeb-4937-951e-e892479dec5e-delete_volume" released by "delete_volume" :: held 5.824s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:24:52 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=11,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:24:53 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:24:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1aac6055-f2a8-4b5a-8719-ae49f6878434 tempest-GroupSnapshotsTest-2008608076 None] Group tempest-GroupSnapshotsTest-Group-1277981777: creating
Jul 06 15:24:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1aac6055-f2a8-4b5a-8719-ae49f6878434 tempest-GroupSnapshotsTest-2008608076 None] Group tempest-GroupSnapshotsTest-Group-1277981777: created successfully
Jul 06 15:24:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1aac6055-f2a8-4b5a-8719-ae49f6878434 tempest-GroupSnapshotsTest-2008608076 None] Create group completed successfully.
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Flow 'volume_create_manager' (d3d03653-0a3a-44af-a85e-24a2cbba58af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44255c3-427b-4a1e-a3e9-76029b341567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44255c3-427b-4a1e-a3e9-76029b341567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-509126857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0055691f-b8e8-4f2d-9372-ba9e1dfed073,host='devstack@QuobyteHD#QuobyteHD',id=94bf6273-4e49-4f6e-ac78-935fcd8d0916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c57847ea9544db2bfe4dba6354113c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:57Z,use_quota=True,user_id='09918e0654a84f3d8102c6864a9abf04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae845dbb-115a-453e-a859-33bf1aa781da),volume_type_id=ae845dbb-115a-453e-a859-33bf1aa781da)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d7b34-39cf-431c-aea9-ec7fdd1d88fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d7b34-39cf-431c-aea9-ec7fdd1d88fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd01ab2-8031-4f90-945d-9151fbc3f86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd01ab2-8031-4f90-945d-9151fbc3f86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bf6273-4e49-4f6e-ac78-935fcd8d0916', 'volume_name': 'volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d0edf3-cb3f-41a9-a8aa-b06fa171905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d0edf3-cb3f-41a9-a8aa-b06fa171905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e2d6e2-1476-4aa3-ac67-4d951f6b13f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:57 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Volume 94bf6273-4e49-4f6e-ac78-935fcd8d0916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916', 'volume_size': 1}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0055691f-b8e8-4f2d-9372-ba9e1dfed073,created_at=2026-07-06T13:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-509126857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0055691f-b8e8-4f2d-9372-ba9e1dfed073,host='devstack@QuobyteHD#QuobyteHD',id=94bf6273-4e49-4f6e-ac78-935fcd8d0916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c57847ea9544db2bfe4dba6354113c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:57Z,use_quota=True,user_id='09918e0654a84f3d8102c6864a9abf04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae845dbb-115a-453e-a859-33bf1aa781da),volume_type_id=ae845dbb-115a-453e-a859-33bf1aa781da)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Creating volume 94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:24:57 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:24:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:24:57 devstack sudo[86946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 1073741824
Jul 06 15:24:57 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:24:58 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root
Jul 06 15:24:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 1073741824" returned: 0 in 1.003s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:24:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:24:58 devstack sudo[86991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916
Jul 06 15:24:58 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:24:59 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root
Jul 06 15:24:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916" returned: 0 in 1.310s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:24:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] <== create_volume: return (2372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:24:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.374s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:24:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e2d6e2-1476-4aa3-ac67-4d951f6b13f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab3968f-70a1-4ea1-a268-18f91633bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:24:59 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Volume volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 (94bf6273-4e49-4f6e-ac78-935fcd8d0916): created successfully
Jul 06 15:24:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab3968f-70a1-4ea1-a268-18f91633bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:24:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Flow 'volume_create_manager' (d3d03653-0a3a-44af-a85e-24a2cbba58af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:24:59 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e0095e89-f79e-444e-8fac-590d14269ff2 tempest-GroupSnapshotsTest-2008608076 None] Created volume successfully.
Jul 06 15:25:01 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] GroupSnapshot f07ad77f-423e-4e76-bc04-ee90dec0f7ae: creating.
Jul 06 15:25:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Group snapshot f07ad77f-423e-4e76-bc04-ee90dec0f7ae: creating. {{(pid=86249) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 15:25:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Creating offline snapshot b27b835f-9e76-478e-abe3-01d69d1bcdf6 of volume 94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:25:01 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[896c55ce-df64-4170-838d-5308b884d495]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:01 devstack sudo[87068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916
Jul 06 15:25:01 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:02 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916" returned: 0 in 1.296s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:03 devstack sudo[87082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 1G
Jul 06 15:25:03 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:05 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 1G" returned: 0 in 2.691s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:05 devstack sudo[87459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6
Jul 06 15:25:05 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:25:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:06 devstack sudo[87488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:25:06 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:08 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.803s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:08 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:25:08 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:25:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 8 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:25:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:25:08 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6" returned: 0 in 2.849s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:08 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:25:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:08 devstack sudo[87535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6
Jul 06 15:25:08 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:09 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6" returned: 0 in 1.248s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:09 devstack sudo[87545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.info
Jul 06 15:25:09 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:11 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.info" returned: 0 in 1.351s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:11 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:11 devstack sudo[87550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.info
Jul 06 15:25:11 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Flow 'volume_create_manager' (f5a1cf4f-6c3f-403c-902c-d4bebbc3178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9706e4a-45f6-4792-911b-5e70f6d7bb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9706e4a-45f6-4792-911b-5e70f6d7bb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-45671799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe24726a45bd454ba70b408a27186472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:12Z,use_quota=True,user_id='aaac99f7877346e292901d32eb8ba907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a27250-fe8f-4868-bbd9-c1180b567891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a27250-fe8f-4868-bbd9-c1180b567891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf6d3fe-198b-4351-9164-bbf832e2548e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf6d3fe-198b-4351-9164-bbf832e2548e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8', 'volume_name': 'volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3d18cb-3aa2-413a-b17a-495cfcf2f137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3d18cb-3aa2-413a-b17a-495cfcf2f137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4a01b3-9bb2-4a9b-8d9b-f303429e14d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:11 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Volume be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8', 'volume_size': 1}
Jul 06 15:25:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:12 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.info" returned: 0 in 1.107s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 10.771s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-45671799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe24726a45bd454ba70b408a27186472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:12Z,use_quota=True,user_id='aaac99f7877346e292901d32eb8ba907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Creating volume be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:25:12 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:25:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:12 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8 1073741824
Jul 06 15:25:12 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4c936b88-b64d-491b-9cda-bc7170ba865c tempest-GroupSnapshotsTest-2008608076 None] group_snapshot f07ad77f-423e-4e76-bc04-ee90dec0f7ae: created successfully
Jul 06 15:25:13 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8 1073741824" returned: 0 in 1.581s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:14 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8
Jul 06 15:25:14 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:14 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8" returned: 0 in 0.836s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] <== create_volume: return (2498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:25:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.504s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4a01b3-9bb2-4a9b-8d9b-f303429e14d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbeb186e-5232-45b1-b809-925803ba168f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:14 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Volume volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8 (be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8): created successfully
Jul 06 15:25:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbeb186e-5232-45b1-b809-925803ba168f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Flow 'volume_create_manager' (f5a1cf4f-6c3f-403c-902c-d4bebbc3178a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:25:14 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-036caa26-7f4a-4c2c-8a2e-ecb5c0d34fdf tempest-VolumesAdminNegativeTest-1522142137 None] Created volume successfully.
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-b27b835f-9e76-478e-abe3-01d69d1bcdf6-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" by "_create_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-b27b835f-9e76-478e-abe3-01d69d1bcdf6-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Creating volume 9c11cdc9-b7a7-4ff6-b571-e7d6624a8486 from snapshot b27b835f-9e76-478e-abe3-01d69d1bcdf6 {{(pid=86249) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] snapshot: b27b835f-9e76-478e-abe3-01d69d1bcdf6, volume: 9c11cdc9-b7a7-4ff6-b571-e7d6624a8486,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d46af-75ef-431a-a71c-ef0db2c7a6f9]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:15 devstack sudo[87649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6
Jul 06 15:25:15 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:17 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6" returned: 0 in 1.900s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d112f28-a37d-491c-9ca8-177d7a833a86]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:17 devstack sudo[87703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916
Jul 06 15:25:17 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Acquiring lock "cinder-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Lock "cinder-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Acquiring lock "cinder-quobyte-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Lock "cinder-quobyte-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fd4aea-cbbf-4f3b-8892-29f8bf518ef2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:18 devstack sudo[87725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8
Jul 06 15:25:18 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:18 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916" returned: 0 in 1.461s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:18 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486 not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:25:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:18 devstack sudo[87731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486
Jul 06 15:25:18 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:19 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8" returned: 0 in 1.440s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:19 devstack sudo[87742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8
Jul 06 15:25:19 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:20 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8" returned: 0 in 1.513s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Lock "cinder-quobyte-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8" released by "delete_volume" :: held 3.132s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:25:21 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Created reservations ['badb2a17-b35e-4bc8-9f36-915d2e82d2e3', 'e1054907-1118-4c7f-9e7a-89dd9b49973c', 'd89613f8-2aae-43cb-a958-d4d7d8abcde7', '722d0534-6f58-4629-b4f3-e1200f7aedfc'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:25:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:21 devstack sudo[87812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:25:21 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:23 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 2.447s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:23 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:25:23 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Deleted volume successfully.
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8c5920a-e3d3-4291-bde4-27e732d1a91a tempest-VolumesAdminNegativeTest-1522142137 None] Lock "cinder-be9ad6cb-6e3e-4866-bf7f-70b47b3d8cc8-delete_volume" released by "delete_volume" :: held 6.439s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Flow 'volume_create_manager' (1b0c0e9c-90de-4897-9b17-26b2a27f29c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d7c966-2cbb-43ec-8109-931031b72404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d7c966-2cbb-43ec-8109-931031b72404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1726772597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ad44ae-a4b3-41b1-8a31-76a457b7cf63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757e80b3d3444b18a64f01b5934e8519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:24Z,use_quota=True,user_id='4dbfd093983e465998f152627deefcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8b5405-42c2-4116-84fc-37bc3eadce82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8b5405-42c2-4116-84fc-37bc3eadce82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a905d425-8152-434e-81b4-68ed37b44e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a905d425-8152-434e-81b4-68ed37b44e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ad44ae-a4b3-41b1-8a31-76a457b7cf63', 'volume_name': 'volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8bf00e-809e-44ee-8f34-b86a664089f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8bf00e-809e-44ee-8f34-b86a664089f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947a82e4-0887-4f3d-bde7-8b5eb6837283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:24 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Volume e5ad44ae-a4b3-41b1-8a31-76a457b7cf63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63', 'volume_size': 1}
Jul 06 15:25:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:26 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" returned: 0 in 8.145s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:26 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8441fc88-b7a2-472f-8504-d4158b6127d2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:26 devstack sudo[87839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916
Jul 06 15:25:26 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:28 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916" returned: 0 in 1.220s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916, size 1024.00 MB, duration 8.15 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:25:28 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Converted 1024.00 MB image at 125.71 MB/s
Jul 06 15:25:28 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:28 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486
Jul 06 15:25:28 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:28 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" returned: 0 in 0.687s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" released by "_copy_volume_from_snapshot" :: held 13.554s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-b27b835f-9e76-478e-abe3-01d69d1bcdf6-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" released by "_create_volume_from_snapshot" :: held 13.598s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.627s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.061s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1726772597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ad44ae-a4b3-41b1-8a31-76a457b7cf63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757e80b3d3444b18a64f01b5934e8519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:24Z,use_quota=True,user_id='4dbfd093983e465998f152627deefcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Creating volume e5ad44ae-a4b3-41b1-8a31-76a457b7cf63 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:25:28 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:25:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:28 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63 1073741824
Jul 06 15:25:28 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:29 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-30b4cc8e-8bd1-45d1-be1c-dbbc16488bf8 tempest-GroupSnapshotsTest-2008608076 None] Create group from source-snapshot-f07ad77f-423e-4e76-bc04-ee90dec0f7ae completed successfully.
Jul 06 15:25:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:25:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" acquired by "delete_volume" :: waited 0.051s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:25:30 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[207c69b1-6918-41d5-9c3e-0e37c9f383cb]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:30 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63 1073741824" returned: 0 in 1.530s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:30 devstack sudo[87862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63
Jul 06 15:25:30 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:30 devstack sudo[87861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486
Jul 06 15:25:30 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:31 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63" returned: 0 in 0.685s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:25:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947a82e4-0887-4f3d-bde7-8b5eb6837283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9474fd-9656-4680-8629-e1f7ec6a183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:31 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Volume volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63 (e5ad44ae-a4b3-41b1-8a31-76a457b7cf63): created successfully
Jul 06 15:25:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9474fd-9656-4680-8629-e1f7ec6a183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Flow 'volume_create_manager' (1b0c0e9c-90de-4897-9b17-26b2a27f29c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:25:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9b6fa616-a600-406e-bfcf-6af90bb53a05 tempest-DeleteServersTestJSON-316092492 None] Created volume successfully.
Jul 06 15:25:31 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" returned: 0 in 0.992s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:31 devstack sudo[87869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486
Jul 06 15:25:31 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:31 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" returned: 0 in 0.789s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:32 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-9c11cdc9-b7a7-4ff6-b571-e7d6624a8486" released by "delete_volume" :: held 1.889s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:25:32 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['24b4c517-4138-4cc9-b06d-8f517c3586b0'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:25:32 devstack cinder-volume[86249]: WARNING cinder.quota [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1595490949 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1595490949, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:25:32 devstack cinder-volume[86249]: WARNING cinder.quota [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1595490949 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1595490949, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:25:32 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['d6e21af3-cf50-4c65-98b9-71f106849ae9', '265d757d-cc30-485a-81b2-90abee9cd64b', 'f001e954-3124-40b4-87bc-6cc9287e0f26', '612c7c78-4a4a-409d-ae56-a233b73d8aa4'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:25:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:32 devstack sudo[87880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:25:32 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] group_snapshot f07ad77f-423e-4e76-bc04-ee90dec0f7ae: deleting
Jul 06 15:25:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] group_snapshot f07ad77f-423e-4e76-bc04-ee90dec0f7ae: deleting {{(pid=86249) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 15:25:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-94bf6273-4e49-4f6e-ac78-935fcd8d0916" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:25:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-94bf6273-4e49-4f6e-ac78-935fcd8d0916" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:25:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-b27b835f-9e76-478e-abe3-01d69d1bcdf6" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:25:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-b27b835f-9e76-478e-abe3-01d69d1bcdf6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:25:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Deleting offline snapshot b27b835f-9e76-478e-abe3-01d69d1bcdf6 of volume 94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:25:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] snapshot_file for this snap is: volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:25:33 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[58719331-a605-4056-91ee-747a729b74c2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:33 devstack sudo[87883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6
Jul 06 15:25:33 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:34 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.726s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:34 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:25:34 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0a2eac94-409b-44eb-bb05-1f0e05fc3931 tempest-GroupSnapshotsTest-2008608076 None] Delete group completed successfully.
Jul 06 15:25:34 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6" returned: 0 in 1.613s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:25:34 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[34681532-cdc8-48d8-bd1a-80d7d9f9ce8c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:35 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916
Jul 06 15:25:35 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:35 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916" returned: 0 in 1.008s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:35 devstack sudo[87933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6
Jul 06 15:25:35 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:36 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6" returned: 0 in 1.040s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:36 devstack sudo[87940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6
Jul 06 15:25:36 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:37 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916.b27b835f-9e76-478e-abe3-01d69d1bcdf6" returned: 0 in 0.730s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-b27b835f-9e76-478e-abe3-01d69d1bcdf6" released by "_delete_snapshot" :: held 4.525s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:25:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-94bf6273-4e49-4f6e-ac78-935fcd8d0916" released by "delete_snapshot" :: held 4.555s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:25:37 devstack cinder-volume[86249]: WARNING cinder.quota [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1595490949 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1595490949, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:25:37 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['649df5e0-ce31-4b2b-9c8e-1ed27ce28917', '48c7576b-8807-4ee4-ae88-b9bd19e818fe', 'f4ff0f90-e379-4788-8e9c-11be6523816e', '2a4743c1-1325-4d09-8d32-d5996316c16e'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:25:37 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-291420d6-867a-4670-bdb2-7592252f8acb tempest-GroupSnapshotsTest-2008608076 None] group_snapshot f07ad77f-423e-4e76-bc04-ee90dec0f7ae: deleted successfully
Jul 06 15:25:38 devstack cinder-volume[86249]: WARNING py.warnings [req-c6551587-c41d-4db4-b989-cc3475e0406a req-c5cf414b-23bb-4c4e-9575-48c3655b9aa1 tempest-DeleteServersTestJSON-316092492 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jul 06 15:25:38 devstack cinder-volume[86249]:   .first()
Jul 06 15:25:38 devstack cinder-volume[86249]: 
Jul 06 15:25:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-c6551587-c41d-4db4-b989-cc3475e0406a req-c5cf414b-23bb-4c4e-9575-48c3655b9aa1 tempest-DeleteServersTestJSON-316092492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-c6551587-c41d-4db4-b989-cc3475e0406a req-c5cf414b-23bb-4c4e-9575-48c3655b9aa1 tempest-DeleteServersTestJSON-316092492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[50745b0e-82f3-42b8-af7b-5ab1af1b2dd1]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-c6551587-c41d-4db4-b989-cc3475e0406a req-c5cf414b-23bb-4c4e-9575-48c3655b9aa1 tempest-DeleteServersTestJSON-316092492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:38 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63
Jul 06 15:25:38 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:38 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-c6551587-c41d-4db4-b989-cc3475e0406a req-c5cf414b-23bb-4c4e-9575-48c3655b9aa1 tempest-DeleteServersTestJSON-316092492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63" returned: 0 in 0.836s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-c6551587-c41d-4db4-b989-cc3475e0406a req-c5cf414b-23bb-4c4e-9575-48c3655b9aa1 tempest-DeleteServersTestJSON-316092492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.862s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-c6551587-c41d-4db4-b989-cc3475e0406a req-c5cf414b-23bb-4c4e-9575-48c3655b9aa1 tempest-DeleteServersTestJSON-316092492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbf23f5c-3a03-4b27-9222-1835c44a4526', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:25:39 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-c6551587-c41d-4db4-b989-cc3475e0406a req-c5cf414b-23bb-4c4e-9575-48c3655b9aa1 tempest-DeleteServersTestJSON-316092492 None] attachment_update completed successfully.
Jul 06 15:25:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-94bf6273-4e49-4f6e-ac78-935fcd8d0916" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:25:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-94bf6273-4e49-4f6e-ac78-935fcd8d0916" acquired by "delete_volume" :: waited 0.055s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:25:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[869f81e1-b301-4470-8dd3-cf4cbdff3a0e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:40 devstack sudo[88003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916
Jul 06 15:25:40 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:40 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916" returned: 0 in 1.028s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:40 devstack sudo[88087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916
Jul 06 15:25:40 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:41 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94bf6273-4e49-4f6e-ac78-935fcd8d0916" returned: 0 in 0.891s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-94bf6273-4e49-4f6e-ac78-935fcd8d0916" released by "delete_volume" :: held 2.154s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:25:41 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['460f5dbd-3ff8-4562-9432-4aeabdb431a9'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:25:41 devstack cinder-volume[86249]: WARNING cinder.db.api [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1595490949']
Jul 06 15:25:41 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['5b88263c-ac83-4cdb-94eb-939a82c9a7f6', '33dcbbf7-0279-4b29-b825-6fbd75316c0c', 'e4654348-77ab-4a05-8bd3-9d2e9fc0348e', 'c789865b-90cb-4fe1-9ff4-4771e82b4ea1'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:25:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:42 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:42 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:42 devstack sudo[88410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:25:42 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:42 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-38c4f242-edb0-4264-a28b-8c0319259d33 tempest-GroupSnapshotsTest-2008608076 None] Group tempest-GroupSnapshotsTest-Group-948902414: creating
Jul 06 15:25:42 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-38c4f242-edb0-4264-a28b-8c0319259d33 tempest-GroupSnapshotsTest-2008608076 None] Group tempest-GroupSnapshotsTest-Group-948902414: created successfully
Jul 06 15:25:42 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-38c4f242-edb0-4264-a28b-8c0319259d33 tempest-GroupSnapshotsTest-2008608076 None] Create group completed successfully.
Jul 06 15:25:43 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.041s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:43 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:25:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bc358fc0-552d-46f9-bd22-98b805b3def7 tempest-GroupSnapshotsTest-2008608076 None] Delete group completed successfully.
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Flow 'volume_create_manager' (f77c5a87-2f0f-41c1-925b-bd75abefd926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68deca74-1b9b-4a7d-a242-6f3bdf5880c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68deca74-1b9b-4a7d-a242-6f3bdf5880c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1254501896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ceeb9a9a-6eb5-42a4-9499-cf8daf12da8f,host='devstack@QuobyteHD#QuobyteHD',id=5bfbff6b-271f-4595-8434-d63a05f61e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c57847ea9544db2bfe4dba6354113c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:45Z,use_quota=True,user_id='09918e0654a84f3d8102c6864a9abf04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d403391-440a-4728-951f-1755a5b0f4aa),volume_type_id=7d403391-440a-4728-951f-1755a5b0f4aa)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d546e74-4f65-4693-a3ad-50cdfb6e426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d546e74-4f65-4693-a3ad-50cdfb6e426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c31b0c-55d2-40c1-bbfc-e7bf1e5512d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c31b0c-55d2-40c1-bbfc-e7bf1e5512d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bfbff6b-271f-4595-8434-d63a05f61e66', 'volume_name': 'volume-5bfbff6b-271f-4595-8434-d63a05f61e66', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37ee463-1acf-46ae-bc1b-96ec36162d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37ee463-1acf-46ae-bc1b-96ec36162d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dd510f-a672-4a56-b734-05309ac27640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:44 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Volume 5bfbff6b-271f-4595-8434-d63a05f61e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bfbff6b-271f-4595-8434-d63a05f61e66', 'volume_size': 1}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ceeb9a9a-6eb5-42a4-9499-cf8daf12da8f,created_at=2026-07-06T13:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1254501896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ceeb9a9a-6eb5-42a4-9499-cf8daf12da8f,host='devstack@QuobyteHD#QuobyteHD',id=5bfbff6b-271f-4595-8434-d63a05f61e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c57847ea9544db2bfe4dba6354113c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:45Z,use_quota=True,user_id='09918e0654a84f3d8102c6864a9abf04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d403391-440a-4728-951f-1755a5b0f4aa),volume_type_id=7d403391-440a-4728-951f-1755a5b0f4aa)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Creating volume 5bfbff6b-271f-4595-8434-d63a05f61e66 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:25:44 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:25:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:44 devstack sudo[88423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66 1073741824
Jul 06 15:25:44 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:45 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66 1073741824" returned: 0 in 0.931s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:45 devstack sudo[88430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66
Jul 06 15:25:45 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:46 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66" returned: 0 in 0.859s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:25:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dd510f-a672-4a56-b734-05309ac27640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfbff6b-271f-4595-8434-d63a05f61e66', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a901e95-9002-4e78-abec-c0ec08e12c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:46 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Volume volume-5bfbff6b-271f-4595-8434-d63a05f61e66 (5bfbff6b-271f-4595-8434-d63a05f61e66): created successfully
Jul 06 15:25:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a901e95-9002-4e78-abec-c0ec08e12c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Flow 'volume_create_manager' (f77c5a87-2f0f-41c1-925b-bd75abefd926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:25:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5d1e3f6f-a0a6-45f2-9b2c-6870f9a94bdd tempest-GroupSnapshotsTest-2008608076 None] Created volume successfully.
Jul 06 15:25:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-e6e2b28f-74c3-4b19-8884-1ca86a604f75 req-725d7943-bc9a-46cd-b813-ff48410114af tempest-TaggedAttachmentsTest-298552033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-e6e2b28f-74c3-4b19-8884-1ca86a604f75 req-725d7943-bc9a-46cd-b813-ff48410114af tempest-TaggedAttachmentsTest-298552033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:47 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfae985-df3f-4182-ada0-4dd6aa07276b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-e6e2b28f-74c3-4b19-8884-1ca86a604f75 req-725d7943-bc9a-46cd-b813-ff48410114af tempest-TaggedAttachmentsTest-298552033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:47 devstack sudo[88489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d
Jul 06 15:25:47 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Flow 'volume_create_manager' (5f21791e-68b7-494d-9439-765772ecaa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695237b3-7057-455d-bc5f-e09e87d85626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695237b3-7057-455d-bc5f-e09e87d85626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-957691616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ceeb9a9a-6eb5-42a4-9499-cf8daf12da8f,host='devstack@QuobyteHD#QuobyteHD',id=0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c57847ea9544db2bfe4dba6354113c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:48Z,use_quota=True,user_id='09918e0654a84f3d8102c6864a9abf04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d403391-440a-4728-951f-1755a5b0f4aa),volume_type_id=7d403391-440a-4728-951f-1755a5b0f4aa)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969a1b8e-a6b3-450a-bd48-b8636829490b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969a1b8e-a6b3-450a-bd48-b8636829490b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033b48c2-953b-4ae0-97ed-3bb9ba65cddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033b48c2-953b-4ae0-97ed-3bb9ba65cddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5', 'volume_name': 'volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a273c66e-29ad-440c-b267-7804b9845f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a273c66e-29ad-440c-b267-7804b9845f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1436c9-52fa-473c-b992-ed5a66e32e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:48 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Volume 0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5', 'volume_size': 1}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:48 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-e6e2b28f-74c3-4b19-8884-1ca86a604f75 req-725d7943-bc9a-46cd-b813-ff48410114af tempest-TaggedAttachmentsTest-298552033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d" returned: 0 in 1.198s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-e6e2b28f-74c3-4b19-8884-1ca86a604f75 req-725d7943-bc9a-46cd-b813-ff48410114af tempest-TaggedAttachmentsTest-298552033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.222s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ceeb9a9a-6eb5-42a4-9499-cf8daf12da8f,created_at=2026-07-06T13:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-957691616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ceeb9a9a-6eb5-42a4-9499-cf8daf12da8f,host='devstack@QuobyteHD#QuobyteHD',id=0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c57847ea9544db2bfe4dba6354113c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:48Z,use_quota=True,user_id='09918e0654a84f3d8102c6864a9abf04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d403391-440a-4728-951f-1755a5b0f4aa),volume_type_id=7d403391-440a-4728-951f-1755a5b0f4aa)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Creating volume 0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:25:48 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:48 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 1073741824
Jul 06 15:25:48 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-e6e2b28f-74c3-4b19-8884-1ca86a604f75 req-725d7943-bc9a-46cd-b813-ff48410114af tempest-TaggedAttachmentsTest-298552033 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc56ea3d-b55b-4e40-b98d-03e2e63b6d8f', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:25:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-e6e2b28f-74c3-4b19-8884-1ca86a604f75 req-725d7943-bc9a-46cd-b813-ff48410114af tempest-TaggedAttachmentsTest-298552033 None] attachment_update completed successfully.
Jul 06 15:25:49 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-b5fffb79-7b81-4acf-a9c9-cf892600bacf req-fc912a53-a26c-4601-8b7f-17540df31fb2 tempest-DeleteServersTestJSON-316092492 None] Terminate volume connection completed successfully.
Jul 06 15:25:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-b5fffb79-7b81-4acf-a9c9-cf892600bacf req-fc912a53-a26c-4601-8b7f-17540df31fb2 tempest-DeleteServersTestJSON-316092492 None] Deleting attachment dbf23f5c-3a03-4b27-9222-1835c44a4526. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:25:49 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 1073741824" returned: 0 in 0.997s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:49 devstack sudo[88573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5
Jul 06 15:25:49 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:50 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" returned: 0 in 0.745s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:25:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1436c9-52fa-473c-b992-ed5a66e32e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf586b8-80c5-4a6e-b4f0-50b101a5964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:25:50 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Volume volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 (0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5): created successfully
Jul 06 15:25:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf586b8-80c5-4a6e-b4f0-50b101a5964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:25:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Flow 'volume_create_manager' (5f21791e-68b7-494d-9439-765772ecaa6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:25:50 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-005fc106-a483-4dd5-a3a9-84a95c8162c6 tempest-GroupSnapshotsTest-2008608076 None] Created volume successfully.
Jul 06 15:25:50 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c493a856-63d4-421d-bd48-e4410627f48b tempest-GroupSnapshotsTest-2008608076 None] Update group completed successfully.
Jul 06 15:25:51 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6119204d-a4a5-4112-818e-c9fe3283676e tempest-GroupSnapshotsTest-2008608076 None] Update group completed successfully.
Jul 06 15:25:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Acquiring lock "cinder-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:25:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Lock "cinder-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:25:52 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=67,cinder:UPDATE=63,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:25:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Acquiring lock "cinder-quobyte-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:25:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Lock "cinder-quobyte-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:25:52 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6157de6c-26ce-4ba4-8e34-001b136dec81]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:52 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63
Jul 06 15:25:52 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:52 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-db7a403d-73f1-4c7c-a7f6-fc132cb2588b tempest-GroupSnapshotsTest-2008608076 None] Update group completed successfully.
Jul 06 15:25:53 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63" returned: 0 in 0.816s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:53 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63
Jul 06 15:25:53 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:54 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=74,cinder:UPDATE=61,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:25:54 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9f2c5ce5-62da-4270-a1bc-2bef78138286 tempest-GroupSnapshotsTest-2008608076 None] Update group completed successfully.
Jul 06 15:25:54 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63" returned: 0 in 0.800s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Lock "cinder-quobyte-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63" released by "delete_volume" :: held 1.676s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:25:54 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Created reservations ['cc437fda-5efb-400b-86a7-f9457fcef420', '3d5df695-ad13-4267-a255-21d6cbaf7700', '542335ec-aa28-4330-a008-dd6cbfff396e', 'abeddfad-e2d0-4ebe-924d-28bb64c8af0b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:25:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:25:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:25:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:25:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:54 devstack sudo[88906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:25:54 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:55 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.710s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:55 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:25:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Deleted volume successfully.
Jul 06 15:25:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b31b8834-b027-43e0-bce9-66e0fcf5d86d tempest-DeleteServersTestJSON-316092492 None] Lock "cinder-e5ad44ae-a4b3-41b1-8a31-76a457b7cf63-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:25:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-d626c82a-1f83-4400-ae02-ea41c3fcf23b req-d47c9202-fa91-4330-90a0-b68ac02d40bd tempest-TaggedAttachmentsTest-298552033 None] Terminate volume connection completed successfully.
Jul 06 15:25:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-d626c82a-1f83-4400-ae02-ea41c3fcf23b req-d47c9202-fa91-4330-90a0-b68ac02d40bd tempest-TaggedAttachmentsTest-298552033 None] Deleting attachment bc56ea3d-b55b-4e40-b98d-03e2e63b6d8f. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:25:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] GroupSnapshot bafc67c5-109e-4de2-ace2-4c8918a641d1: creating.
Jul 06 15:25:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Group snapshot bafc67c5-109e-4de2-ace2-4c8918a641d1: creating. {{(pid=86249) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 15:25:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:25:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:25:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Creating offline snapshot a35a6ba1-8b70-4801-a8f5-e5ee3cae179d of volume 5bfbff6b-271f-4595-8434-d63a05f61e66 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:25:55 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87e238e-9a14-4ea7-bf7a-dbed93cf93e5]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:25:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:55 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66
Jul 06 15:25:55 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:56 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66" returned: 0 in 1.111s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:57 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d 1G
Jul 06 15:25:57 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:58 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d 1G" returned: 0 in 1.109s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bfbff6b-271f-4595-8434-d63a05f61e66 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:58 devstack sudo[88949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bfbff6b-271f-4595-8434-d63a05f61e66 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d
Jul 06 15:25:58 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:25:59 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root
Jul 06 15:25:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bfbff6b-271f-4595-8434-d63a05f61e66 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d" returned: 0 in 1.237s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:25:59 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:25:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:25:59 devstack sudo[89007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d
Jul 06 15:25:59 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:00 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d" returned: 0 in 0.826s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:00 devstack sudo[89012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.info
Jul 06 15:26:00 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:01 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.info" returned: 0 in 0.878s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:01 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:26:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:01 devstack sudo[89017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.info
Jul 06 15:26:01 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:02 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.info" returned: 0 in 1.019s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.279s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Creating offline snapshot a7b40f2a-edce-43d2-8d4f-95aa99b69958 of volume 0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:26:02 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4597fd09-936b-4555-8aba-1dacc563f6eb]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:02 devstack sudo[89023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5
Jul 06 15:26:02 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:03 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" returned: 0 in 1.119s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:03 devstack sudo[89029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958 1G
Jul 06 15:26:03 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:04 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958 1G" returned: 0 in 1.205s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:04 devstack sudo[89039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958
Jul 06 15:26:04 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:05 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958" returned: 0 in 0.952s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:05 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:26:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:05 devstack sudo[89051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958
Jul 06 15:26:05 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:06 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958" returned: 0 in 0.840s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:06 devstack sudo[89056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.info
Jul 06 15:26:06 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:26:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:26:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:26:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:06 devstack sudo[89060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:26:06 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:07 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.info" returned: 0 in 0.822s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:07 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:26:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:07 devstack sudo[89070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.info
Jul 06 15:26:07 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:07 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.869s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:26:08 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.info" returned: 0 in 1.017s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.068s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:08 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1f7f96cd-60d6-4568-9dd4-385e028c70ad tempest-GroupSnapshotsTest-2008608076 None] group_snapshot bafc67c5-109e-4de2-ace2-4c8918a641d1: created successfully
Jul 06 15:26:08 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] group_snapshot bafc67c5-109e-4de2-ace2-4c8918a641d1: deleting
Jul 06 15:26:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] group_snapshot bafc67c5-109e-4de2-ace2-4c8918a641d1: deleting {{(pid=86249) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 15:26:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-5bfbff6b-271f-4595-8434-d63a05f61e66" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-5bfbff6b-271f-4595-8434-d63a05f61e66" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-a35a6ba1-8b70-4801-a8f5-e5ee3cae179d" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-a35a6ba1-8b70-4801-a8f5-e5ee3cae179d" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Deleting offline snapshot a35a6ba1-8b70-4801-a8f5-e5ee3cae179d of volume 5bfbff6b-271f-4595-8434-d63a05f61e66 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:26:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] snapshot_file for this snap is: volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:26:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa2e633-e8a0-4a2d-b192-a0d41e47c385]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:09 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d
Jul 06 15:26:09 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:10 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d" returned: 0 in 1.201s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bfbff6b-271f-4595-8434-d63a05f61e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:26:10 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[343b1bfd-f95d-4ea9-ac18-3ae6fb1f08c3]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:10 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66
Jul 06 15:26:10 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:11 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66" returned: 0 in 1.128s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:11 devstack sudo[89113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d
Jul 06 15:26:11 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:12 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d" returned: 0 in 1.018s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:12 devstack sudo[89133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d
Jul 06 15:26:12 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:13 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66.a35a6ba1-8b70-4801-a8f5-e5ee3cae179d" returned: 0 in 0.731s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-a35a6ba1-8b70-4801-a8f5-e5ee3cae179d" released by "_delete_snapshot" :: held 4.247s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-5bfbff6b-271f-4595-8434-d63a05f61e66" released by "delete_snapshot" :: held 4.329s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-a7b40f2a-edce-43d2-8d4f-95aa99b69958" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-a7b40f2a-edce-43d2-8d4f-95aa99b69958" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Deleting offline snapshot a7b40f2a-edce-43d2-8d4f-95aa99b69958 of volume 0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] snapshot_file for this snap is: volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[674a238d-4928-4666-86af-9a3b63839e7e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:13 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958
Jul 06 15:26:13 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:14 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958" returned: 0 in 1.189s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:26:14 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[564dd53d-b684-431e-9d83-dd509420577b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:14 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5
Jul 06 15:26:14 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:15 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" returned: 0 in 1.000s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:15 devstack sudo[89164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958
Jul 06 15:26:15 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:16 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958" returned: 0 in 1.033s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:16 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958
Jul 06 15:26:16 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:17 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5.a7b40f2a-edce-43d2-8d4f-95aa99b69958" returned: 0 in 0.738s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-a7b40f2a-edce-43d2-8d4f-95aa99b69958" released by "_delete_snapshot" :: held 4.171s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" released by "delete_snapshot" :: held 4.207s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:17 devstack cinder-volume[86249]: WARNING cinder.quota [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-581892784 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-581892784, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:26:17 devstack cinder-volume[86249]: WARNING cinder.quota [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-581892784 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-581892784, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:26:17 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['ad1ad0d8-357d-4c01-99f3-93d5e8e49e13', 'b3e2e207-579d-410b-8129-d83fdb761eb2', '7e76b846-2646-41a7-866d-f52b8d2273ac', '7f04491a-53fb-4df3-8b0a-620bdbaba5b8'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:26:17 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['1807df9d-cf90-4d0a-94f8-b9fffde8d27c', '03f0bcb1-85bd-4b4f-bce5-fa186a73a140', 'e240a6e1-a359-4f9e-995d-a6a2c28b13ea', '93e3c612-ec1f-439c-8023-93b032d1c8cb'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:26:17 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-463a8602-d8a7-4051-ac73-f2fd2ebe9545 tempest-GroupSnapshotsTest-2008608076 None] group_snapshot bafc67c5-109e-4de2-ace2-4c8918a641d1: deleted successfully
Jul 06 15:26:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" acquired by "delete_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:19 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6079840-5479-4fe7-a4ad-e4fe8f286838]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:19 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5
Jul 06 15:26:19 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:20 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" returned: 0 in 1.088s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:20 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5
Jul 06 15:26:20 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Acquiring lock "cinder-2e6608b1-9a63-443d-ab0e-cd2465173b7d-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Lock "cinder-2e6608b1-9a63-443d-ab0e-cd2465173b7d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Acquiring lock "cinder-quobyte-2e6608b1-9a63-443d-ab0e-cd2465173b7d" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Lock "cinder-quobyte-2e6608b1-9a63-443d-ab0e-cd2465173b7d" acquired by "delete_volume" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[195641ff-0a02-4c5a-b62c-0b4546911ad0]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:21 devstack sudo[89188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d
Jul 06 15:26:21 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" returned: 0 in 1.129s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:21 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-0fa5febf-f259-48a6-b4ab-d3a9faaf8eb5" released by "delete_volume" :: held 2.325s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-5bfbff6b-271f-4595-8434-d63a05f61e66" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-5bfbff6b-271f-4595-8434-d63a05f61e66" acquired by "delete_volume" :: waited 0.102s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db6d10e-9516-4367-9d1f-3fe6414fcd7e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:22 devstack sudo[89212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66
Jul 06 15:26:22 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:22 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d" returned: 0 in 1.498s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:22 devstack sudo[89251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d
Jul 06 15:26:22 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:23 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66" returned: 0 in 1.705s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:23 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66
Jul 06 15:26:23 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:23 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2e6608b1-9a63-443d-ab0e-cd2465173b7d" returned: 0 in 1.014s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Lock "cinder-quobyte-2e6608b1-9a63-443d-ab0e-cd2465173b7d" released by "delete_volume" :: held 2.609s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:23 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Created reservations ['73b93d1c-7f76-4707-a1e3-3d8fbd69af43', '6002695c-6683-48bb-af15-31ddd680ca33', 'c54ff405-8f0b-4ff4-a57d-b969d9149f78', 'dfea4ee0-7ffe-4dee-a48b-826011a72273'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:26:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:26:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:26:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:24 devstack sudo[89313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:26:24 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:24 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5bfbff6b-271f-4595-8434-d63a05f61e66" returned: 0 in 0.952s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:24 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-5bfbff6b-271f-4595-8434-d63a05f61e66" released by "delete_volume" :: held 2.845s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:24 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['0d4b1bfb-573e-4ed3-99b7-9670156c3993'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:26:24 devstack cinder-volume[86249]: WARNING cinder.quota [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-581892784 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-581892784, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:26:24 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['679cff33-042d-4746-9fdb-98c4f33e430c', '1eca8bae-cab7-408d-812b-06a5312ad730', '768c48a8-f34b-40a7-b7df-66773e0965a5', 'fe722bee-688e-4f9d-9c10-debf0d4e9606'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:26:25 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['74e2c854-f0a6-4a8d-8a77-68eaf193a5c2', '527bd7f1-5bd5-4c88-98be-45dd405c8759', '7a312a55-786c-4378-82e7-e277fe466056', 'f1a519ac-6c72-46a6-a3a0-39ed6293fb7d'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:26:25 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:26:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:26:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.336s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:25 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:26:25 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Deleted volume successfully.
Jul 06 15:26:25 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:26:25 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-94f8f12a-ba5e-495c-896a-dd1efbd391b5 tempest-TaggedAttachmentsTest-298552033 None] Lock "cinder-2e6608b1-9a63-443d-ab0e-cd2465173b7d-delete_volume" released by "delete_volume" :: held 4.303s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:26 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.862s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:26 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:26:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b2652cf4-b1b7-4571-a195-29c5b9e88f60 tempest-GroupSnapshotsTest-2008608076 None] Delete group completed successfully.
Jul 06 15:26:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-08750052-87ae-4e43-96c5-34fb57c29c1b tempest-GroupSnapshotsTest-2008608076 None] Group tempest-GroupSnapshotsTest-Group-1176956406: creating
Jul 06 15:26:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-08750052-87ae-4e43-96c5-34fb57c29c1b tempest-GroupSnapshotsTest-2008608076 None] Group tempest-GroupSnapshotsTest-Group-1176956406: created successfully
Jul 06 15:26:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-08750052-87ae-4e43-96c5-34fb57c29c1b tempest-GroupSnapshotsTest-2008608076 None] Create group completed successfully.
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Flow 'volume_create_manager' (701afe6f-998b-425d-a947-09953fa8b696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c39b84f-29b3-4122-91a1-ec6c31eb5359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c39b84f-29b3-4122-91a1-ec6c31eb5359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-998486069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8337098e-2269-47dd-b298-f3381b70f335,host='devstack@QuobyteHD#QuobyteHD',id=81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c57847ea9544db2bfe4dba6354113c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:28Z,use_quota=True,user_id='09918e0654a84f3d8102c6864a9abf04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(031f0fd7-d016-4465-8e50-a5f37205eb8a),volume_type_id=031f0fd7-d016-4465-8e50-a5f37205eb8a)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9a5a31-b40b-4db3-9be1-0689aafa7563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9a5a31-b40b-4db3-9be1-0689aafa7563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c432e34-0575-41b2-9d48-c456bb163292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c432e34-0575-41b2-9d48-c456bb163292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c', 'volume_name': 'volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317a3ab1-7b82-4df3-a7dc-cc9cdb80c261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317a3ab1-7b82-4df3-a7dc-cc9cdb80c261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839abc28-dc4e-49ea-98e6-4ae6e068be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:28 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Volume 81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c', 'volume_size': 1}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8337098e-2269-47dd-b298-f3381b70f335,created_at=2026-07-06T13:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-998486069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8337098e-2269-47dd-b298-f3381b70f335,host='devstack@QuobyteHD#QuobyteHD',id=81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c57847ea9544db2bfe4dba6354113c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:28Z,use_quota=True,user_id='09918e0654a84f3d8102c6864a9abf04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(031f0fd7-d016-4465-8e50-a5f37205eb8a),volume_type_id=031f0fd7-d016-4465-8e50-a5f37205eb8a)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Creating volume 81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:26:28 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:26:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:28 devstack sudo[89331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c 1073741824
Jul 06 15:26:28 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:30 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c 1073741824" returned: 0 in 1.614s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:30 devstack sudo[89340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c
Jul 06 15:26:30 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:32 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" returned: 0 in 1.823s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] <== create_volume: return (3508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:26:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.516s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839abc28-dc4e-49ea-98e6-4ae6e068be6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0893c47-b299-4d22-aff7-60e7466efa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:32 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Volume volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c (81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c): created successfully
Jul 06 15:26:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0893c47-b299-4d22-aff7-60e7466efa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Flow 'volume_create_manager' (701afe6f-998b-425d-a947-09953fa8b696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:26:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3a8cc146-86e9-4c98-afa7-3ca4a4d8b009 tempest-GroupSnapshotsTest-2008608076 None] Created volume successfully.
Jul 06 15:26:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] GroupSnapshot c22f691e-ff83-4eb7-b1e3-856b6595b3ce: creating.
Jul 06 15:26:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Group snapshot c22f691e-ff83-4eb7-b1e3-856b6595b3ce: creating. {{(pid=86249) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 15:26:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Creating offline snapshot a7fdfd0f-e3e2-4884-b026-256c3f277411 of volume 81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:26:33 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc233acd-9293-42c1-b084-22c4771dda1c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:33 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c
Jul 06 15:26:33 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:35 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" returned: 0 in 2.041s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:35 devstack sudo[89374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411 1G
Jul 06 15:26:35 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:36 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411 1G" returned: 0 in 1.294s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:36 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411
Jul 06 15:26:36 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:37 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411" returned: 0 in 1.077s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:37 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:26:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:37 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411
Jul 06 15:26:37 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:38 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411" returned: 0 in 1.195s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:39 devstack sudo[89398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.info
Jul 06 15:26:39 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:40 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.info" returned: 0 in 1.437s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:40 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:26:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:40 devstack sudo[89409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.info
Jul 06 15:26:40 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:41 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.info" returned: 0 in 1.435s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.693s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:42 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-af63a72e-adf5-446c-8130-92d47de4d156 tempest-GroupSnapshotsTest-2008608076 None] group_snapshot c22f691e-ff83-4eb7-b1e3-856b6595b3ce: created successfully
Jul 06 15:26:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] group_snapshot c22f691e-ff83-4eb7-b1e3-856b6595b3ce: deleting
Jul 06 15:26:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] group_snapshot c22f691e-ff83-4eb7-b1e3-856b6595b3ce: deleting {{(pid=86249) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 15:26:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-a7fdfd0f-e3e2-4884-b026-256c3f277411" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-a7fdfd0f-e3e2-4884-b026-256c3f277411" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Deleting offline snapshot a7fdfd0f-e3e2-4884-b026-256c3f277411 of volume 81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:26:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] snapshot_file for this snap is: volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:26:43 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6feef7-a090-4f23-82fa-bcad1d885704]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:44 devstack sudo[89468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411
Jul 06 15:26:44 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:45 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411" returned: 0 in 1.573s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:26:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1a21c1-34dd-4a74-9be7-2f24027ff4f8]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:45 devstack sudo[89535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c
Jul 06 15:26:45 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:46 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" returned: 0 in 1.199s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:46 devstack sudo[89545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411
Jul 06 15:26:46 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:47 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411" returned: 0 in 1.171s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:47 devstack sudo[89551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411
Jul 06 15:26:47 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:49 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c.a7fdfd0f-e3e2-4884-b026-256c3f277411" returned: 0 in 1.147s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-a7fdfd0f-e3e2-4884-b026-256c3f277411" released by "_delete_snapshot" :: held 5.368s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:49 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-597e65f0-b082-439c-a1ac-b06f29873005 tempest-GroupSnapshotsV319Test-200036168 None] Group tempest-GroupSnapshotsV319Test-Group-1864160048: creating
Jul 06 15:26:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" released by "delete_snapshot" :: held 5.435s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:49 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-597e65f0-b082-439c-a1ac-b06f29873005 tempest-GroupSnapshotsV319Test-200036168 None] Group tempest-GroupSnapshotsV319Test-Group-1864160048: created successfully
Jul 06 15:26:49 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-597e65f0-b082-439c-a1ac-b06f29873005 tempest-GroupSnapshotsV319Test-200036168 None] Create group completed successfully.
Jul 06 15:26:49 devstack cinder-volume[86249]: WARNING cinder.quota [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1921806882 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1921806882, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:26:49 devstack cinder-volume[86249]: WARNING cinder.quota [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1921806882 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1921806882, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:26:49 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['7176ed1d-cb93-4ab4-8b0a-8f4636e87e6a', 'acaa10cb-06dd-4941-888a-ddd2f2493314', 'fa00cbc9-0b79-49e8-96ea-ae4131659d4e', '9b75393a-218c-422f-a350-5a97fd357916'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:26:49 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1dfca043-d058-4c7b-aca1-f7c23d054839 tempest-GroupSnapshotsTest-2008608076 None] group_snapshot c22f691e-ff83-4eb7-b1e3-856b6595b3ce: deleted successfully
Jul 06 15:26:51 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:26:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Flow 'volume_create_manager' (41b6e105-f6b9-4013-bc5d-f48f056a1472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:26:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533312b9-4e43-42c2-814a-be347ff709d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533312b9-4e43-42c2-814a-be347ff709d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2038211223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=70181ff0-4485-4cf7-96be-21ce963f024d,host='devstack@QuobyteHD#QuobyteHD',id=4fd013e2-9df2-4c02-b949-073118696e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6961ac8e1cb4ddbb4e72b69464ad0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:52Z,use_quota=True,user_id='c639668b3f5e423a8703d1806de7b2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6aab348-5abf-423b-84c3-15bacea95dd0),volume_type_id=c6aab348-5abf-423b-84c3-15bacea95dd0)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5400d1e8-6797-444c-9f97-d52aeb54d34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5400d1e8-6797-444c-9f97-d52aeb54d34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45eea33-82e9-4fb1-a4df-d19f26c36b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45eea33-82e9-4fb1-a4df-d19f26c36b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd013e2-9df2-4c02-b949-073118696e6d', 'volume_name': 'volume-4fd013e2-9df2-4c02-b949-073118696e6d', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc964772-aaed-4b30-a18b-e735d13909d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc964772-aaed-4b30-a18b-e735d13909d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9d6047-35ae-4c21-90ec-fbd39cfe2632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Volume 4fd013e2-9df2-4c02-b949-073118696e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd013e2-9df2-4c02-b949-073118696e6d', 'volume_size': 1}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=70181ff0-4485-4cf7-96be-21ce963f024d,created_at=2026-07-06T13:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2038211223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=70181ff0-4485-4cf7-96be-21ce963f024d,host='devstack@QuobyteHD#QuobyteHD',id=4fd013e2-9df2-4c02-b949-073118696e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6961ac8e1cb4ddbb4e72b69464ad0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:52Z,use_quota=True,user_id='c639668b3f5e423a8703d1806de7b2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6aab348-5abf-423b-84c3-15bacea95dd0),volume_type_id=c6aab348-5abf-423b-84c3-15bacea95dd0)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Creating volume 4fd013e2-9df2-4c02-b949-073118696e6d {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:26:52 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:52 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d 1073741824
Jul 06 15:26:52 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Flow 'volume_create_manager' (cc8189c0-4498-4f29-8219-6e7476c14431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b86e27b-384f-4a36-b5c9-a0ecedb91e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "cinder-quobyte-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b86e27b-384f-4a36-b5c9-a0ecedb91e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-285444490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b6c67e-2f78-439d-865f-22fde835051b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6271110c514ef4b085516fd83d0571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:52Z,use_quota=True,user_id='6865179cfec64781acb7171bcf1af8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75945604-5c7c-4be6-a6bb-edd553631a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75945604-5c7c-4be6-a6bb-edd553631a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c5810a-5bdf-4840-9317-045f7590cf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c5810a-5bdf-4840-9317-045f7590cf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b6c67e-2f78-439d-865f-22fde835051b', 'volume_name': 'volume-29b6c67e-2f78-439d-865f-22fde835051b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559f8058-4068-445c-8ead-e2197780dc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559f8058-4068-445c-8ead-e2197780dc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff25b8be-66bd-44e9-b3e4-09ac1f008c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Volume 29b6c67e-2f78-439d-865f-22fde835051b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b6c67e-2f78-439d-865f-22fde835051b', 'volume_size': 1}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" acquired by "delete_volume" :: waited 0.163s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c04b1ff-c33f-40bc-a3c1-842e6be18f9c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:53 devstack sudo[89584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c
Jul 06 15:26:53 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:54 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d 1073741824" returned: 0 in 1.912s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:54 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=70,cinder:UPDATE=66,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:26:54 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=65,cinder:UPDATE=68,cinder:INSERT=18 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:26:54 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" returned: 0 in 1.441s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:54 devstack sudo[89595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c
Jul 06 15:26:54 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:54 devstack sudo[89597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d
Jul 06 15:26:54 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:55 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" returned: 0 in 0.845s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Lock "cinder-quobyte-81ecd1f6-d011-42fc-a6af-e1c5c10f6c8c" released by "delete_volume" :: held 2.446s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['65616e14-02d6-426c-9d43-f1385c97074f'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:26:55 devstack cinder-volume[86249]: WARNING cinder.quota [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1921806882 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1921806882, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Created reservations ['67027022-961c-47be-8aeb-e918daffe4d5', '89fc12b9-4095-4ca3-8e57-8e52012e2c10', 'db41f11c-ef0a-41fb-9bc3-09cbf91699b0', '562fd4d5-fdfb-4eed-b2bd-d40192d25215'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:55 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:26:55 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:55 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d" returned: 0 in 1.325s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] <== create_volume: return (3539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.561s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.994s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-285444490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b6c67e-2f78-439d-865f-22fde835051b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6271110c514ef4b085516fd83d0571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:52Z,use_quota=True,user_id='6865179cfec64781acb7171bcf1af8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Creating volume 29b6c67e-2f78-439d-865f-22fde835051b {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:26:55 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9d6047-35ae-4c21-90ec-fbd39cfe2632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd013e2-9df2-4c02-b949-073118696e6d', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:55 devstack sudo[89603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b 1073741824
Jul 06 15:26:55 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3698f533-09cc-44a6-9b69-5f2b8d2fdf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:55 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Volume volume-4fd013e2-9df2-4c02-b949-073118696e6d (4fd013e2-9df2-4c02-b949-073118696e6d): created successfully
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3698f533-09cc-44a6-9b69-5f2b8d2fdf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Flow 'volume_create_manager' (41b6e105-f6b9-4013-bc5d-f48f056a1472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:26:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d9a2c9d5-ec08-4cec-a7a7-27679818e781 tempest-GroupSnapshotsV319Test-200036168 None] Created volume successfully.
Jul 06 15:26:56 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] GroupSnapshot e3c28f93-b568-4219-9218-8c34cd3baeb6: creating.
Jul 06 15:26:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Group snapshot e3c28f93-b568-4219-9218-8c34cd3baeb6: creating. {{(pid=86249) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 15:26:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:26:56 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b 1073741824" returned: 0 in 1.226s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:56 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.432s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:56 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:26:56 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-42e9d37c-7ca7-46c8-b09c-42df14f99e8d tempest-GroupSnapshotsTest-2008608076 None] Delete group completed successfully.
Jul 06 15:26:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:57 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b
Jul 06 15:26:57 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:57 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b" returned: 0 in 0.994s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:26:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:26:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.271s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:26:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff25b8be-66bd-44e9-b3e4-09ac1f008c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b6c67e-2f78-439d-865f-22fde835051b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9337d8d8-b073-4e7d-857f-d6ccef5e3430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:26:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Creating offline snapshot 6180d39d-a57e-4d8d-9698-5d192ee01931 of volume 4fd013e2-9df2-4c02-b949-073118696e6d {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:26:58 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Volume volume-29b6c67e-2f78-439d-865f-22fde835051b (29b6c67e-2f78-439d-865f-22fde835051b): created successfully
Jul 06 15:26:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9337d8d8-b073-4e7d-857f-d6ccef5e3430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:26:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Flow 'volume_create_manager' (cc8189c0-4498-4f29-8219-6e7476c14431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:26:58 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f8a51-b7fd-41f4-9e48-23699f0401c1]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:26:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:58 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7d0c4988-e6db-447a-ace9-0c09d659af5f tempest-ServerRescueNegativeTestJSON-1521455774 None] Created volume successfully.
Jul 06 15:26:58 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d
Jul 06 15:26:58 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:26:59 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Jul 06 15:26:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d" returned: 0 in 1.441s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:26:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:26:59 devstack sudo[89635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931 1G
Jul 06 15:26:59 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:01 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931 1G" returned: 0 in 1.780s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fd013e2-9df2-4c02-b949-073118696e6d -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:01 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fd013e2-9df2-4c02-b949-073118696e6d -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931
Jul 06 15:27:01 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:02 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fd013e2-9df2-4c02-b949-073118696e6d -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931" returned: 0 in 0.887s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:02 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:27:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:02 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931
Jul 06 15:27:02 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:03 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931" returned: 0 in 0.845s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:03 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.info
Jul 06 15:27:03 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:03 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.info" returned: 0 in 0.763s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:03 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:27:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:03 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.info
Jul 06 15:27:03 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7ebe8164-9265-436a-965b-32c3564d72a8 tempest-GroupsV320Test-1594218244 None] Group tempest-GroupsV320Test-Group-2032334609: creating
Jul 06 15:27:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7ebe8164-9265-436a-965b-32c3564d72a8 tempest-GroupsV320Test-1594218244 None] Group tempest-GroupsV320Test-Group-2032334609: created successfully
Jul 06 15:27:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7ebe8164-9265-436a-965b-32c3564d72a8 tempest-GroupsV320Test-1594218244 None] Create group completed successfully.
Jul 06 15:27:04 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.info" returned: 0 in 0.787s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.667s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b689e136-e9f0-4596-ae5f-592e683a8ab3 tempest-GroupSnapshotsV319Test-200036168 None] group_snapshot e3c28f93-b568-4219-9218-8c34cd3baeb6: created successfully
Jul 06 15:27:05 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] group_snapshot e3c28f93-b568-4219-9218-8c34cd3baeb6: deleting
Jul 06 15:27:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] group_snapshot e3c28f93-b568-4219-9218-8c34cd3baeb6: deleting {{(pid=86249) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 15:27:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Acquiring lock "cinder-quobyte-4fd013e2-9df2-4c02-b949-073118696e6d" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Lock "cinder-quobyte-4fd013e2-9df2-4c02-b949-073118696e6d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Acquiring lock "cinder-quobyte-6180d39d-a57e-4d8d-9698-5d192ee01931" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Lock "cinder-quobyte-6180d39d-a57e-4d8d-9698-5d192ee01931" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Deleting offline snapshot 6180d39d-a57e-4d8d-9698-5d192ee01931 of volume 4fd013e2-9df2-4c02-b949-073118696e6d {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:27:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] snapshot_file for this snap is: volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:27:05 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dafc0d5-8a63-483a-b4ee-fc488203dec2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:05 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-3d3c507c-3651-4ccd-9062-d04bf9793d6f tempest-GroupsV320Test-1594218244 None] Created reservations ['86eabb77-8f16-4bc2-97f1-96720169764a'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:27:06 devstack sudo[89734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931
Jul 06 15:27:06 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3d3c507c-3651-4ccd-9062-d04bf9793d6f tempest-GroupsV320Test-1594218244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3d3c507c-3651-4ccd-9062-d04bf9793d6f tempest-GroupsV320Test-1594218244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3d3c507c-3651-4ccd-9062-d04bf9793d6f tempest-GroupsV320Test-1594218244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3d3c507c-3651-4ccd-9062-d04bf9793d6f tempest-GroupsV320Test-1594218244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3d3c507c-3651-4ccd-9062-d04bf9793d6f tempest-GroupsV320Test-1594218244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3d3c507c-3651-4ccd-9062-d04bf9793d6f tempest-GroupsV320Test-1594218244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:06 devstack sudo[89736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:27:06 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:06 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:27:06 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:06 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931" returned: 0 in 0.851s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fd013e2-9df2-4c02-b949-073118696e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:27:06 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3d3c507c-3651-4ccd-9062-d04bf9793d6f tempest-GroupsV320Test-1594218244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.725s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-3d3c507c-3651-4ccd-9062-d04bf9793d6f tempest-GroupsV320Test-1594218244 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:27:06 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3d3c507c-3651-4ccd-9062-d04bf9793d6f tempest-GroupsV320Test-1594218244 None] Delete group completed successfully.
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c7b8f9-f12e-46ec-966b-9f14f8b80212]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:06 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d
Jul 06 15:27:06 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:07 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.846s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:27:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:27:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 8 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:27:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:27:07 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d" returned: 0 in 0.933s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:07 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931
Jul 06 15:27:07 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:08 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931" returned: 0 in 0.997s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:08 devstack sudo[89775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931
Jul 06 15:27:08 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:09 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d.6180d39d-a57e-4d8d-9698-5d192ee01931" returned: 0 in 0.880s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Lock "cinder-quobyte-6180d39d-a57e-4d8d-9698-5d192ee01931" released by "_delete_snapshot" :: held 3.833s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:27:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Lock "cinder-quobyte-4fd013e2-9df2-4c02-b949-073118696e6d" released by "delete_snapshot" :: held 3.872s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:27:09 devstack cinder-volume[86249]: WARNING cinder.quota [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-880316896 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-880316896, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:27:09 devstack cinder-volume[86249]: WARNING cinder.quota [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-880316896 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-880316896, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:27:09 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] Created reservations ['35d0aa2c-553e-43f1-a785-81c2fe1d1670', 'a52ed531-b39c-4b12-8bd6-9d437f19415e', 'a0f0beb8-2c7e-4ff5-bf5b-96cef25cc76d', '2a3e80fb-bc58-4605-9554-a577b59e54a9'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:27:09 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0dbadd6c-f29c-4987-b32d-7d9ffc79c41c tempest-GroupSnapshotsV319Test-200036168 None] group_snapshot e3c28f93-b568-4219-9218-8c34cd3baeb6: deleted successfully
Jul 06 15:27:10 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Acquiring lock "cinder-quobyte-4fd013e2-9df2-4c02-b949-073118696e6d" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:10 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Lock "cinder-quobyte-4fd013e2-9df2-4c02-b949-073118696e6d" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:10 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c17b738-585f-43a9-8b7f-c4c92364343a]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:11 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d
Jul 06 15:27:11 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Flow 'volume_create_manager' (07e350cb-b9b7-4565-b323-08bee3a1ed11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bad8b3-1561-4a92-a2a8-7aa804fc18fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bad8b3-1561-4a92-a2a8-7aa804fc18fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-936849459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20b2b3d-b7eb-4202-b34e-c7d088ec089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3babd53ae2470f94f62d1ae9fff692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:11Z,use_quota=True,user_id='bdf9827a4b6e4b88a748b9f7b3739018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a25ccc9-a202-47c9-9d72-8b88c5cbb80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a25ccc9-a202-47c9-9d72-8b88c5cbb80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a487b8e4-1f12-4422-9459-92a677741a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a487b8e4-1f12-4422-9459-92a677741a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f20b2b3d-b7eb-4202-b34e-c7d088ec089a', 'volume_name': 'volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54235673-b03d-4032-ab97-bcaadf20aa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54235673-b03d-4032-ab97-bcaadf20aa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c031e366-b741-4d79-ba5b-c860be765433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:11 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Volume f20b2b3d-b7eb-4202-b34e-c7d088ec089a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a', 'volume_size': 1}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-936849459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20b2b3d-b7eb-4202-b34e-c7d088ec089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3babd53ae2470f94f62d1ae9fff692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:11Z,use_quota=True,user_id='bdf9827a4b6e4b88a748b9f7b3739018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Creating volume f20b2b3d-b7eb-4202-b34e-c7d088ec089a {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:27:11 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:27:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:11 devstack sudo[89793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a 1073741824
Jul 06 15:27:11 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:12 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d" returned: 0 in 1.481s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:12 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d
Jul 06 15:27:12 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:13 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4fd013e2-9df2-4c02-b949-073118696e6d" returned: 0 in 1.125s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Lock "cinder-quobyte-4fd013e2-9df2-4c02-b949-073118696e6d" released by "delete_volume" :: held 2.752s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:27:13 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Created reservations ['e998fca5-7ebe-4196-980d-6843ae159010'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:27:13 devstack cinder-volume[86249]: WARNING cinder.quota [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-880316896 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-880316896, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:27:13 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Created reservations ['cba00521-4947-44cf-8cb7-669c5bf46586', '3a517b2f-2933-41f6-98a9-7461db30138a', '1db20b0f-986c-4fea-9cb3-ad630c497a8e', '1c9e2809-f207-4c45-9748-d0c7afb18261'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:27:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:27:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:27:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:14 devstack sudo[89805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:27:14 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:14 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a 1073741824" returned: 0 in 2.434s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:14 devstack sudo[89807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a
Jul 06 15:27:14 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:15 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.083s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:15 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:27:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-eada5f6d-3235-4423-9933-1f73f60d5cdc tempest-GroupSnapshotsV319Test-200036168 None] Delete group completed successfully.
Jul 06 15:27:15 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a" returned: 0 in 1.440s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] <== create_volume: return (3966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:27:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.969s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c031e366-b741-4d79-ba5b-c860be765433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbd733b-68ee-42b2-abed-4b6372ac396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:15 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Volume volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a (f20b2b3d-b7eb-4202-b34e-c7d088ec089a): created successfully
Jul 06 15:27:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbd733b-68ee-42b2-abed-4b6372ac396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Flow 'volume_create_manager' (07e350cb-b9b7-4565-b323-08bee3a1ed11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:27:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e0950297-7971-4bc6-94c4-ddc915a6ec5e tempest-ServerActionsTestOtherA-1377191639 None] Created volume successfully.
Jul 06 15:27:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Acquiring lock "cinder-29b6c67e-2f78-439d-865f-22fde835051b-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Lock "cinder-29b6c67e-2f78-439d-865f-22fde835051b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Acquiring lock "cinder-quobyte-29b6c67e-2f78-439d-865f-22fde835051b" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Lock "cinder-quobyte-29b6c67e-2f78-439d-865f-22fde835051b" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:19 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c2e86-84fc-4d86-bae8-dd0f7f592e2e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:19 devstack sudo[89849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b
Jul 06 15:27:19 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:20 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b" returned: 0 in 1.272s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:20 devstack sudo[89854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b
Jul 06 15:27:20 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-29b6c67e-2f78-439d-865f-22fde835051b" returned: 0 in 1.085s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:21 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Lock "cinder-quobyte-29b6c67e-2f78-439d-865f-22fde835051b" released by "delete_volume" :: held 2.424s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:27:21 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Created reservations ['2561ac89-c1ed-4258-b4d2-84112d60a656', '200db98a-4b02-4e56-ac66-69ab4b4d2095', 'cb3b5ae9-2086-4892-af7e-afd6728ef390', '0d80baf4-6c22-4151-ae8b-f4714d4f21a9'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:27:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:27:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:27:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:21 devstack sudo[89863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:27:21 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:23 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.291s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:23 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:27:23 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Deleted volume successfully.
Jul 06 15:27:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4b327e17-555d-4231-b71f-bcd9284df637 tempest-ServerRescueNegativeTestJSON-1521455774 None] Lock "cinder-29b6c67e-2f78-439d-865f-22fde835051b-delete_volume" released by "delete_volume" :: held 4.062s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Flow 'volume_create_manager' (fad68afe-607e-424a-b7c9-fceef4e0375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50753576-970b-4d24-a787-6f18cde0693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50753576-970b-4d24-a787-6f18cde0693d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1576022101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425682fa1ac945d58f04a8737b12599f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:28Z,use_quota=True,user_id='5352ab2e8c024ddcbce7f8427b80004b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb22e32-6279-49fe-b5e4-1c6d7d8ae67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb22e32-6279-49fe-b5e4-1c6d7d8ae67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97df9d54-5e88-4e54-b59a-4f8eb5525977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97df9d54-5e88-4e54-b59a-4f8eb5525977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b', 'volume_name': 'volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee44f0d3-04be-42f4-844e-91e9c943e95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee44f0d3-04be-42f4-844e-91e9c943e95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98e10dd-afff-49af-839f-58a2072b7c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:27 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Volume 7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b', 'volume_size': 1}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1576022101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425682fa1ac945d58f04a8737b12599f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:28Z,use_quota=True,user_id='5352ab2e8c024ddcbce7f8427b80004b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Creating volume 7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:27:27 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:27:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:27 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b 1073741824
Jul 06 15:27:27 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:28 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b 1073741824" returned: 0 in 1.270s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:29 devstack sudo[89921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b
Jul 06 15:27:29 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:29 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b" returned: 0 in 0.948s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:27:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98e10dd-afff-49af-839f-58a2072b7c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea2ca29-c6ac-4bdc-8c6f-7b5784242547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:30 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Volume volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b (7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b): created successfully
Jul 06 15:27:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea2ca29-c6ac-4bdc-8c6f-7b5784242547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Flow 'volume_create_manager' (fad68afe-607e-424a-b7c9-fceef4e0375f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:27:30 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f2012d95-8f0e-41c6-92ca-6fe3d0b5ba33 tempest-VolumesServicesTestJSON-1426463792 None] Created volume successfully.
Jul 06 15:27:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Acquiring lock "cinder-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Lock "cinder-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Acquiring lock "cinder-quobyte-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Lock "cinder-quobyte-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:31 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[73923659-f9c5-4c81-9b91-ed77a5da323f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:31 devstack sudo[89949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b
Jul 06 15:27:31 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:32 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b" returned: 0 in 0.899s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:32 devstack sudo[89965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b
Jul 06 15:27:32 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:32 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b" returned: 0 in 0.759s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:32 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Lock "cinder-quobyte-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b" released by "delete_volume" :: held 1.728s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Created reservations ['a700cf89-c8b4-45aa-9f36-d3472ee38f57', 'ad8e216d-ed89-4e72-a2b4-00b3fae03b36', '0d3144b7-facb-49bb-b4d4-47481fa96cbb', 'f0d5a2dd-da15-432a-98a3-52673c45a9e2'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:33 devstack sudo[89983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:27:33 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Flow 'volume_create_manager' (31899d89-188c-49c5-ad70-b4e6a482095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5b4026-d5c5-45b9-af70-5eb0da284628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5b4026-d5c5-45b9-af70-5eb0da284628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1608002296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9cf422-c100-4ac5-ad13-8c64d109e6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1063f31cb7424cb1ee528827dd269a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:33Z,use_quota=True,user_id='f3a0c3d175e34fa5a27048579afa9f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff58bbb-bd80-4590-a769-bea2cfe2e001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff58bbb-bd80-4590-a769-bea2cfe2e001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a10054f-5c43-4e87-bb19-94abb951d845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a10054f-5c43-4e87-bb19-94abb951d845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d9cf422-c100-4ac5-ad13-8c64d109e6f4', 'volume_name': 'volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3059409-2045-4d48-829a-1ccbbda1f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3059409-2045-4d48-829a-1ccbbda1f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20994879-7de2-44db-a457-fc4914fc6070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:33 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4', 'volume_size': 1}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1608002296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9cf422-c100-4ac5-ad13-8c64d109e6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1063f31cb7424cb1ee528827dd269a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:33Z,use_quota=True,user_id='f3a0c3d175e34fa5a27048579afa9f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Creating volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:27:33 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:27:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:33 devstack sudo[89996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 1073741824
Jul 06 15:27:33 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:34 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.588s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:34 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:27:34 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Deleted volume successfully.
Jul 06 15:27:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6835e745-bed6-4ad5-a07c-00c219a35f73 tempest-VolumesServicesTestJSON-1426463792 None] Lock "cinder-7c3a49ff-0de3-4a42-8df4-096e5d5fbb6b-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:27:35 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 1073741824" returned: 0 in 2.045s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:35 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4
Jul 06 15:27:35 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:36 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" returned: 0 in 0.870s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] <== create_volume: return (2997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:27:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20994879-7de2-44db-a457-fc4914fc6070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3bed46-6a41-486e-9887-7d909576501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:36 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Volume volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 (0d9cf422-c100-4ac5-ad13-8c64d109e6f4): created successfully
Jul 06 15:27:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3bed46-6a41-486e-9887-7d909576501a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Flow 'volume_create_manager' (31899d89-188c-49c5-ad70-b4e6a482095b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:27:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2f09275d-14ba-42af-8fa4-157a2ae0e07f tempest-SnapshotsActionsTest-1246980254 None] Created volume successfully.
Jul 06 15:27:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Creating offline snapshot e844d874-3d89-4e4e-8525-98c9973a2d91 of volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:27:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8800e5c-28a2-4094-92d8-b57ceaef2bed]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:38 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4
Jul 06 15:27:38 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:39 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" returned: 0 in 1.155s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:39 devstack sudo[90042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 1G
Jul 06 15:27:39 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:40 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 1G" returned: 0 in 1.211s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:40 devstack sudo[90051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:27:40 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:41 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 0.881s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:41 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 is being set with open permissions: ugo+rw
Jul 06 15:27:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:41 devstack sudo[90058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:27:41 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:42 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 1.134s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:42 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.info
Jul 06 15:27:42 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Flow 'volume_create_manager' (27b066cc-4654-44ce-b9a8-31236b1754cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3842809-a7cd-4855-aa7f-2ef3e5cbf822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3842809-a7cd-4855-aa7f-2ef3e5cbf822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1963587756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd709fe1-ed0a-4012-8fe9-9517f717d033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040c5d0e9a46441e8e5e9b182b74326a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:43Z,use_quota=True,user_id='90bab081d20c4da99942f25aa1543968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8d583b-ab87-4ecf-beed-162b8bc5e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8d583b-ab87-4ecf-beed-162b8bc5e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e5759b-87c3-4141-92b9-fac94f70e6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e5759b-87c3-4141-92b9-fac94f70e6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd709fe1-ed0a-4012-8fe9-9517f717d033', 'volume_name': 'volume-bd709fe1-ed0a-4012-8fe9-9517f717d033', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d58933-e8d4-4cfc-b373-71aac5871fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d58933-e8d4-4cfc-b373-71aac5871fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866b00ea-a09f-4df4-b4ba-9dac2b36c31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:43 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Volume bd709fe1-ed0a-4012-8fe9-9517f717d033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd709fe1-ed0a-4012-8fe9-9517f717d033', 'volume_size': 1}
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:43 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.info" returned: 0 in 0.869s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:43 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.info is being set with open permissions: ugo+rw
Jul 06 15:27:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:43 devstack sudo[90066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.info
Jul 06 15:27:43 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:44 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.info" returned: 0 in 0.998s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.403s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1963587756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd709fe1-ed0a-4012-8fe9-9517f717d033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040c5d0e9a46441e8e5e9b182b74326a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:43Z,use_quota=True,user_id='90bab081d20c4da99942f25aa1543968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Creating volume bd709fe1-ed0a-4012-8fe9-9517f717d033 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:27:44 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:27:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:44 devstack sudo[90070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 1073741824
Jul 06 15:27:44 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:44 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c47a3ab6-3e29-4c2e-8ffe-9c6d6dc9571d tempest-SnapshotsActionsTest-1246980254 None] Create snapshot completed successfully
Jul 06 15:27:45 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 1073741824" returned: 0 in 0.933s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:45 devstack sudo[90077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033
Jul 06 15:27:45 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:46 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033" returned: 0 in 0.955s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866b00ea-a09f-4df4-b4ba-9dac2b36c31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd709fe1-ed0a-4012-8fe9-9517f717d033', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97356fa1-b5de-400f-8815-a66af18a8c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] Creating offline snapshot edaade31-fc79-4b6c-b8a4-ea5bf524315e of volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:27:46 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Volume volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 (bd709fe1-ed0a-4012-8fe9-9517f717d033): created successfully
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97356fa1-b5de-400f-8815-a66af18a8c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Flow 'volume_create_manager' (27b066cc-4654-44ce-b9a8-31236b1754cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddfe4d3-a58a-4617-a454-f5d6d48f2d93]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2c1c6bf3-171b-422f-9e08-4c4c13d71f8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Created volume successfully.
Jul 06 15:27:46 devstack sudo[90095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:27:46 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:47 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 0.794s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:27:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:47 devstack sudo[90100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e 1G
Jul 06 15:27:47 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:48 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e 1G" returned: 0 in 0.950s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:48 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e
Jul 06 15:27:48 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:49 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e" returned: 0 in 0.756s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:49 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e is being set with open permissions: ugo+rw
Jul 06 15:27:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:49 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e
Jul 06 15:27:49 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:49 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e" returned: 0 in 0.648s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.292s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.162s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Creating offline snapshot e1309b33-e20f-48fa-bf28-3e6622875e72 of volume bd709fe1-ed0a-4012-8fe9-9517f717d033 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:27:49 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-165a5c7b-18ab-43c7-bb52-73c6fef90014 tempest-SnapshotsActionsTest-1246980254 None] Create snapshot completed successfully
Jul 06 15:27:49 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[00089e80-3af6-4e9e-86cf-326f05e1403b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:50 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033
Jul 06 15:27:50 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:50 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-edaade31-fc79-4b6c-b8a4-ea5bf524315e-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033" returned: 0 in 0.917s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-edaade31-fc79-4b6c-b8a4-ea5bf524315e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:50 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72 1G
Jul 06 15:27:50 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-quobyte-edaade31-fc79-4b6c-b8a4-ea5bf524315e" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-edaade31-fc79-4b6c-b8a4-ea5bf524315e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Deleting offline snapshot edaade31-fc79-4b6c-b8a4-ea5bf524315e of volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] snapshot_file for this snap is: volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c4222d-14da-4208-b754-b2c7aa63a8b3]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:50 devstack sudo[90122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e
Jul 06 15:27:50 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:51 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72 1G" returned: 0 in 0.876s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:51 devstack sudo[90130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72
Jul 06 15:27:51 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:51 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e" returned: 0 in 0.816s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:27:51 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee4325b-8f4f-4ded-af80-3284243ba90f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:51 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:27:51 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:52 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72" returned: 0 in 0.724s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:52 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72 is being set with open permissions: ugo+rw
Jul 06 15:27:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:52 devstack sudo[90138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72
Jul 06 15:27:52 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:52 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 0.805s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:27:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:52 devstack sudo[90142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e
Jul 06 15:27:52 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:53 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72" returned: 0 in 0.851s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:53 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.info
Jul 06 15:27:53 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:53 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e" returned: 0 in 1.208s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:53 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e
Jul 06 15:27:53 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:54 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.info" returned: 0 in 0.835s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:54 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.info is being set with open permissions: ugo+rw
Jul 06 15:27:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:54 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.info
Jul 06 15:27:54 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:54 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.edaade31-fc79-4b6c-b8a4-ea5bf524315e" returned: 0 in 1.046s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-edaade31-fc79-4b6c-b8a4-ea5bf524315e" released by "_delete_snapshot" :: held 4.007s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:27:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" released by "delete_snapshot" :: held 4.043s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:27:54 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=68,cinder:SELECT=66,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:27:54 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=63,cinder:UPDATE=70,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:27:55 devstack cinder-volume[86249]: WARNING cinder.quota [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:27:55 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:55 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Created reservations ['30c0a135-1016-47df-a2b5-6eb9d09766b0', '0c0f5ed5-935b-4654-8e71-040429be3488', '41af3d98-23c3-41f0-a8c8-f54e8c34a491', '77e8ea1e-c311-4fda-8632-ee967d1abc2b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:27:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.info" returned: 0 in 1.013s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.338s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:27:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6a3fe4a5-8abe-4b00-8af2-07681ea6442a tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Create snapshot completed successfully
Jul 06 15:27:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Delete snapshot completed successfully.
Jul 06 15:27:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-92d5d858-ee5f-4778-92cf-9cb02c68f3db tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-edaade31-fc79-4b6c-b8a4-ea5bf524315e-delete_snapshot" released by "delete_snapshot" :: held 4.431s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] Creating offline snapshot e45460a8-4691-465b-a6dd-2bd7372b2010 of volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce58e6dd-d3f0-416d-8521-069ac57135cb]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Acquiring lock "cinder-e1309b33-e20f-48fa-bf28-3e6622875e72-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "cinder-e1309b33-e20f-48fa-bf28-3e6622875e72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Acquiring lock "cinder-quobyte-bd709fe1-ed0a-4012-8fe9-9517f717d033" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "cinder-quobyte-bd709fe1-ed0a-4012-8fe9-9517f717d033" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Acquiring lock "cinder-quobyte-e1309b33-e20f-48fa-bf28-3e6622875e72" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "cinder-quobyte-e1309b33-e20f-48fa-bf28-3e6622875e72" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Deleting offline snapshot e1309b33-e20f-48fa-bf28-3e6622875e72 of volume bd709fe1-ed0a-4012-8fe9-9517f717d033 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:27:56 devstack sudo[90159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:27:56 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] snapshot_file for this snap is: volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e969911-627d-42fb-9641-2f8a8e2c39ec]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:56 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72
Jul 06 15:27:56 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:57 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 1.096s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:27:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:57 devstack sudo[90169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010 1G
Jul 06 15:27:57 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:57 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72" returned: 0 in 0.990s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd709fe1-ed0a-4012-8fe9-9517f717d033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:27:57 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c9df92-a9fc-4019-a035-40fa82116f7c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:27:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:57 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033
Jul 06 15:27:57 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:58 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010 1G" returned: 0 in 0.898s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:58 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033" returned: 0 in 0.809s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:58 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010
Jul 06 15:27:58 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:58 devstack sudo[90181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72
Jul 06 15:27:58 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:59 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010" returned: 0 in 0.751s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:59 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010 is being set with open permissions: ugo+rw
Jul 06 15:27:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:59 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010
Jul 06 15:27:59 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:27:59 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root
Jul 06 15:27:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72" returned: 0 in 0.888s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:27:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:27:59 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72
Jul 06 15:27:59 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:00 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010" returned: 0 in 0.728s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.596s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:00 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8ac81e47-612a-4b99-925e-dd15270fece6 tempest-SnapshotsActionsTest-1246980254 None] Create snapshot completed successfully
Jul 06 15:28:00 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033.e1309b33-e20f-48fa-bf28-3e6622875e72" returned: 0 in 0.698s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "cinder-quobyte-e1309b33-e20f-48fa-bf28-3e6622875e72" released by "_delete_snapshot" :: held 3.509s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "cinder-quobyte-bd709fe1-ed0a-4012-8fe9-9517f717d033" released by "delete_snapshot" :: held 3.538s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Created reservations ['ed07e35a-e383-40b6-8776-a3192796d87f', '59af3a07-e0d7-4c4d-99e3-5cfed7a67516', '00cdb792-9108-4a9c-9a48-fbd083a4c09b', 'cfa7f7b0-98d4-4d05-be93-27901c0782fe'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:00 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Delete snapshot completed successfully.
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ec92bc88-fae3-4283-9373-05b2bbced864 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "cinder-e1309b33-e20f-48fa-bf28-3e6622875e72-delete_snapshot" released by "delete_snapshot" :: held 3.660s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-e45460a8-4691-465b-a6dd-2bd7372b2010-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-e45460a8-4691-465b-a6dd-2bd7372b2010-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-quobyte-e45460a8-4691-465b-a6dd-2bd7372b2010" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-e45460a8-4691-465b-a6dd-2bd7372b2010" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Deleting offline snapshot e45460a8-4691-465b-a6dd-2bd7372b2010 of volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] snapshot_file for this snap is: volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4059ad8d-fc69-4a7b-bc44-5e33f2a180b3]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Acquiring lock "cinder-bd709fe1-ed0a-4012-8fe9-9517f717d033-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:00 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010
Jul 06 15:28:00 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "cinder-bd709fe1-ed0a-4012-8fe9-9517f717d033-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Acquiring lock "cinder-quobyte-bd709fe1-ed0a-4012-8fe9-9517f717d033" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "cinder-quobyte-bd709fe1-ed0a-4012-8fe9-9517f717d033" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:01 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[50adcb0c-9096-4163-8ac0-600bc56aa624]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:01 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033
Jul 06 15:28:01 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:01 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010" returned: 0 in 0.790s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:28:01 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[804c1623-aa11-4f1d-ae4b-f0c59e1f987e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:01 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:28:01 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:01 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033" returned: 0 in 0.902s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:02 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033
Jul 06 15:28:02 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:02 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 0.886s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:02 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010
Jul 06 15:28:02 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:02 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bd709fe1-ed0a-4012-8fe9-9517f717d033" returned: 0 in 0.717s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "cinder-quobyte-bd709fe1-ed0a-4012-8fe9-9517f717d033" released by "delete_volume" :: held 1.684s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Created reservations ['ce9b062b-3873-436e-9574-59be84870f33', '9dc4dda2-3266-4c56-a5c3-a89ae5600cbf', 'be5190c4-3a82-40a7-9e9a-17e561033424', 'b4205d71-77e1-4a46-bd0b-37331a9cc355'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-099b192a-f51e-4e03-a9bd-affa74be97e3 req-95ad5b8f-e861-47bc-aab4-23557976bb25 tempest-ServerActionsTestOtherA-1377191639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-099b192a-f51e-4e03-a9bd-affa74be97e3 req-95ad5b8f-e861-47bc-aab4-23557976bb25 tempest-ServerActionsTestOtherA-1377191639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca78aef0-a135-4680-ae58-7d813da60db6]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-099b192a-f51e-4e03-a9bd-affa74be97e3 req-95ad5b8f-e861-47bc-aab4-23557976bb25 tempest-ServerActionsTestOtherA-1377191639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:02 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:28:02 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:03 devstack sudo[90276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a
Jul 06 15:28:03 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:03 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010" returned: 0 in 1.034s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:03 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010
Jul 06 15:28:03 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:03 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.904s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:03 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:28:03 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Deleted volume successfully.
Jul 06 15:28:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d2fbbe41-f1f1-4da9-bfab-c8882be2cde3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340610203 None] Lock "cinder-bd709fe1-ed0a-4012-8fe9-9517f717d033-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:03 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-099b192a-f51e-4e03-a9bd-affa74be97e3 req-95ad5b8f-e861-47bc-aab4-23557976bb25 tempest-ServerActionsTestOtherA-1377191639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a" returned: 0 in 1.005s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-099b192a-f51e-4e03-a9bd-affa74be97e3 req-95ad5b8f-e861-47bc-aab4-23557976bb25 tempest-ServerActionsTestOtherA-1377191639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.038s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-099b192a-f51e-4e03-a9bd-affa74be97e3 req-95ad5b8f-e861-47bc-aab4-23557976bb25 tempest-ServerActionsTestOtherA-1377191639 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f40f7957-5b81-4fc0-829a-7014a2f777ad', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:28:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-099b192a-f51e-4e03-a9bd-affa74be97e3 req-95ad5b8f-e861-47bc-aab4-23557976bb25 tempest-ServerActionsTestOtherA-1377191639 None] attachment_update completed successfully.
Jul 06 15:28:04 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e45460a8-4691-465b-a6dd-2bd7372b2010" returned: 0 in 1.089s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-e45460a8-4691-465b-a6dd-2bd7372b2010" released by "_delete_snapshot" :: held 3.952s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" released by "delete_snapshot" :: held 3.986s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:04 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Created reservations ['df2f9c13-ae9a-4f33-b9a2-18b9b111e260', '24eca88f-aebc-42be-a213-9487ca426673', '81a81d14-f6cf-43af-b7cf-7771fa0ba9a8', '9ed7c422-5de7-4d2c-bb6d-136ef299b83b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:05 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Delete snapshot completed successfully.
Jul 06 15:28:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-26052778-b255-4ca7-acc1-b92e4720bb93 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-e45460a8-4691-465b-a6dd-2bd7372b2010-delete_snapshot" released by "delete_snapshot" :: held 4.233s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] Creating offline snapshot b0ee9548-c1b1-49b3-8225-27dce77f6c51 of volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:28:05 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50e319c-047d-4850-a9b0-67954a5fbdda]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:05 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:28:05 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:06 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 1.108s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:28:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:28:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:06 devstack sudo[90700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51 1G
Jul 06 15:28:06 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:06 devstack sudo[90702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:28:06 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:07 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.844s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:28:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:28:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 8 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:28:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:28:07 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51 1G" returned: 0 in 1.064s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:07 devstack sudo[90709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51
Jul 06 15:28:07 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:08 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51" returned: 0 in 0.752s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:08 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51 is being set with open permissions: ugo+rw
Jul 06 15:28:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:08 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51
Jul 06 15:28:08 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:09 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51" returned: 0 in 0.693s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.737s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:09 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-88f32d05-5eca-4bdf-8fc3-2a8d89b056e1 tempest-SnapshotsActionsTest-1246980254 None] Create snapshot completed successfully
Jul 06 15:28:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-b0ee9548-c1b1-49b3-8225-27dce77f6c51-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-b0ee9548-c1b1-49b3-8225-27dce77f6c51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-quobyte-b0ee9548-c1b1-49b3-8225-27dce77f6c51" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-b0ee9548-c1b1-49b3-8225-27dce77f6c51" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Deleting offline snapshot b0ee9548-c1b1-49b3-8225-27dce77f6c51 of volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:28:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] snapshot_file for this snap is: volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:28:10 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a4ea23-fda4-49db-a27e-1d0e77419072]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:10 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51
Jul 06 15:28:10 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:11 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51" returned: 0 in 1.256s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bc2ea3-fbe8-4ec5-a9ce-13b8d76fb0c4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:11 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:28:11 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Flow 'volume_create_manager' (e1860470-ae91-4ea2-a6a2-5e57884dd7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2089d6-58ee-4cf3-b449-0f59905b083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2089d6-58ee-4cf3-b449-0f59905b083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1951521612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad799fc8-b588-4b90-9d2f-307e9bc3a1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070a60b51b7c46d1b13514c87d115e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:12Z,use_quota=True,user_id='0160e1f0c6d54deabd50e0749e18926e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc61f37d-db92-4ad1-bac8-05b182eb0dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc61f37d-db92-4ad1-bac8-05b182eb0dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35066df2-ad06-488b-9648-aebaafefb9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35066df2-ad06-488b-9648-aebaafefb9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad799fc8-b588-4b90-9d2f-307e9bc3a1db', 'volume_name': 'volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091c55d9-1dac-445e-85d0-a950ca65f9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091c55d9-1dac-445e-85d0-a950ca65f9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a549030-8e59-4e51-b18f-f8f8ddf92a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:11 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Volume ad799fc8-b588-4b90-9d2f-307e9bc3a1db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db', 'volume_size': 1}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1951521612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad799fc8-b588-4b90-9d2f-307e9bc3a1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070a60b51b7c46d1b13514c87d115e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:12Z,use_quota=True,user_id='0160e1f0c6d54deabd50e0749e18926e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Creating volume ad799fc8-b588-4b90-9d2f-307e9bc3a1db {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:28:11 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:28:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:11 devstack sudo[90812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db 1073741824
Jul 06 15:28:11 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:12 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 0.894s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:28:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:12 devstack sudo[90817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51
Jul 06 15:28:12 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:13 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db 1073741824" returned: 0 in 1.097s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:13 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-af2ad740-fd26-4856-ad77-60bce977574e req-3e5e91d0-cf01-483e-a631-7ab809264f77 tempest-ServerActionsTestOtherA-1377191639 None] Terminate volume connection completed successfully.
Jul 06 15:28:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-af2ad740-fd26-4856-ad77-60bce977574e req-3e5e91d0-cf01-483e-a631-7ab809264f77 tempest-ServerActionsTestOtherA-1377191639 None] Deleting attachment f40f7957-5b81-4fc0-829a-7014a2f777ad. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:28:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:13 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db
Jul 06 15:28:13 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:13 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51" returned: 0 in 1.040s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:13 devstack sudo[90863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51
Jul 06 15:28:13 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:13 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db" returned: 0 in 0.878s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:28:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a549030-8e59-4e51-b18f-f8f8ddf92a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb08d873-27c7-4e19-9854-f6d836ab3ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:14 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Volume volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db (ad799fc8-b588-4b90-9d2f-307e9bc3a1db): created successfully
Jul 06 15:28:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb08d873-27c7-4e19-9854-f6d836ab3ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Flow 'volume_create_manager' (e1860470-ae91-4ea2-a6a2-5e57884dd7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:14 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3365b6dd-0ddd-4dbb-b0e4-16bda1bea098 tempest-VolumesTransfersV357Test-865829522 None] Created volume successfully.
Jul 06 15:28:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.b0ee9548-c1b1-49b3-8225-27dce77f6c51" returned: 0 in 0.918s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:14 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:14 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-b0ee9548-c1b1-49b3-8225-27dce77f6c51" released by "_delete_snapshot" :: held 4.412s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:14 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" released by "delete_snapshot" :: held 4.471s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:14 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Created reservations ['7fd40bb3-a6d4-47d5-8a5d-197f45a3c863', '62778c25-b24c-4a8d-a098-a57960d76d7e', '6be32a77-6a44-4b2e-a688-2294a02e0e71', 'b125c0a4-05e5-49ff-8800-72b4585e1705'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:14 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Delete snapshot completed successfully.
Jul 06 15:28:14 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-992b219d-6f5b-4f32-9bff-4f7a60614c35 tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-b0ee9548-c1b1-49b3-8225-27dce77f6c51-delete_snapshot" released by "delete_snapshot" :: held 4.780s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] Creating offline snapshot 8e17ad90-87c9-4aae-b389-475dbbc8dd11 of volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:28:15 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[90876c79-aed2-4a1c-b925-9f910d731385]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-af2ad740-fd26-4856-ad77-60bce977574e req-013dbff5-2194-44e3-8a1f-2b7395ada6ba tempest-ServerActionsTestOtherA-1377191639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:16 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:28:16 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:16 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9f6eeb83-c941-4e59-88da-d4b2c9b5223d tempest-VolumesTransfersV357Test-1777161301 None] Transfer volume completed successfully.
Jul 06 15:28:16 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 1.186s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:28:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:16 devstack sudo[90905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11 1G
Jul 06 15:28:16 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Acquiring lock "cinder-ad799fc8-b588-4b90-9d2f-307e9bc3a1db-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Lock "cinder-ad799fc8-b588-4b90-9d2f-307e9bc3a1db-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Acquiring lock "cinder-quobyte-ad799fc8-b588-4b90-9d2f-307e9bc3a1db" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Lock "cinder-quobyte-ad799fc8-b588-4b90-9d2f-307e9bc3a1db" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:17 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c3577e-9a7a-41fe-9b77-a5ecab14ae6d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:17 devstack sudo[90909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db
Jul 06 15:28:17 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:18 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11 1G" returned: 0 in 1.077s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:18 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11
Jul 06 15:28:18 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:18 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db" returned: 0 in 0.921s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:18 devstack sudo[90921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db
Jul 06 15:28:18 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:18 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11" returned: 0 in 0.853s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:18 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11 is being set with open permissions: ugo+rw
Jul 06 15:28:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:18 devstack sudo[90926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11
Jul 06 15:28:18 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:19 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad799fc8-b588-4b90-9d2f-307e9bc3a1db" returned: 0 in 0.830s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Lock "cinder-quobyte-ad799fc8-b588-4b90-9d2f-307e9bc3a1db" released by "delete_volume" :: held 1.817s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Created reservations ['f934bcb4-628a-4adb-8619-9f29fb933a99', 'f65b95c0-44f7-4e54-accb-36f87d70ba2f', '97b4efac-3643-4953-9c34-949a30e07a8f', '13baf38c-dd6b-469a-ac92-cc2a41a1d94c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:19 devstack sudo[90931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:28:19 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:19 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11" returned: 0 in 0.724s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.042s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-af2ad740-fd26-4856-ad77-60bce977574e req-013dbff5-2194-44e3-8a1f-2b7395ada6ba tempest-ServerActionsTestOtherA-1377191639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.636s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73fb872-3a98-4039-8649-7aa226969f09]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-af2ad740-fd26-4856-ad77-60bce977574e req-013dbff5-2194-44e3-8a1f-2b7395ada6ba tempest-ServerActionsTestOtherA-1377191639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:19 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8759c3f4-772e-4f8b-a289-2679510dee69 tempest-SnapshotsActionsTest-1246980254 None] Create snapshot completed successfully
Jul 06 15:28:19 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a
Jul 06 15:28:19 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-8e17ad90-87c9-4aae-b389-475dbbc8dd11-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:20 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.977s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:28:20 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Deleted volume successfully.
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-8e17ad90-87c9-4aae-b389-475dbbc8dd11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.099s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5b5bfa91-d7bb-4235-97e7-dec499402ee3 tempest-VolumesTransfersV357Test-1108521940 None] Lock "cinder-ad799fc8-b588-4b90-9d2f-307e9bc3a1db-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Acquiring lock "cinder-quobyte-8e17ad90-87c9-4aae-b389-475dbbc8dd11" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-8e17ad90-87c9-4aae-b389-475dbbc8dd11" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Deleting offline snapshot 8e17ad90-87c9-4aae-b389-475dbbc8dd11 of volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] snapshot_file for this snap is: volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c082046f-2eea-4e65-91f9-2bfd98b15125]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Flow 'volume_create_manager' (a776e455-9efb-49ad-99b9-5ede371585cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6dd8b68-5f8e-425a-a533-e5fa428bed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6dd8b68-5f8e-425a-a533-e5fa428bed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1136936494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdef1a7-0e78-4ec3-996b-6d8563de44f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070a60b51b7c46d1b13514c87d115e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:21Z,use_quota=True,user_id='0160e1f0c6d54deabd50e0749e18926e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:20 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11
Jul 06 15:28:20 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff14d13c-8aaa-4071-bfbc-95c47b6dbd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff14d13c-8aaa-4071-bfbc-95c47b6dbd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6197517-2866-4324-8fc8-ae133437174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6197517-2866-4324-8fc8-ae133437174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cdef1a7-0e78-4ec3-996b-6d8563de44f7', 'volume_name': 'volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969d5a67-a3f8-445c-bc01-7f3b7bc53fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969d5a67-a3f8-445c-bc01-7f3b7bc53fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a25caef-1c1c-4f3d-b70b-cbe785de9cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:20 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Volume 3cdef1a7-0e78-4ec3-996b-6d8563de44f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7', 'volume_size': 1}
Jul 06 15:28:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:21 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-af2ad740-fd26-4856-ad77-60bce977574e req-013dbff5-2194-44e3-8a1f-2b7395ada6ba tempest-ServerActionsTestOtherA-1377191639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a" returned: 0 in 1.363s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-af2ad740-fd26-4856-ad77-60bce977574e req-013dbff5-2194-44e3-8a1f-2b7395ada6ba tempest-ServerActionsTestOtherA-1377191639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.398s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.087s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1136936494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdef1a7-0e78-4ec3-996b-6d8563de44f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070a60b51b7c46d1b13514c87d115e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:21Z,use_quota=True,user_id='0160e1f0c6d54deabd50e0749e18926e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Creating volume 3cdef1a7-0e78-4ec3-996b-6d8563de44f7 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:28:21 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:21 devstack sudo[90941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7 1073741824
Jul 06 15:28:21 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-af2ad740-fd26-4856-ad77-60bce977574e req-013dbff5-2194-44e3-8a1f-2b7395ada6ba tempest-ServerActionsTestOtherA-1377191639 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88c107ff-5ec3-42be-80aa-1cbdc9a6dce0', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:28:21 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-af2ad740-fd26-4856-ad77-60bce977574e req-013dbff5-2194-44e3-8a1f-2b7395ada6ba tempest-ServerActionsTestOtherA-1377191639 None] attachment_update completed successfully.
Jul 06 15:28:21 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11" returned: 0 in 1.243s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:28:22 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[045d4a9a-f657-45e0-bdb7-22d0eec5f3a2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:22 devstack sudo[90953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:28:22 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:23 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7 1073741824" returned: 0 in 1.980s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:23 devstack sudo[90958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7
Jul 06 15:28:23 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:23 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 1.592s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:28:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:23 devstack sudo[90968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11
Jul 06 15:28:23 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:24 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7" returned: 0 in 1.267s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] <== create_volume: return (3345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:28:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.360s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a25caef-1c1c-4f3d-b70b-cbe785de9cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e95298-fb25-4cbe-a470-5c2e62fdca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:24 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Volume volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7 (3cdef1a7-0e78-4ec3-996b-6d8563de44f7): created successfully
Jul 06 15:28:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e95298-fb25-4cbe-a470-5c2e62fdca6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Flow 'volume_create_manager' (a776e455-9efb-49ad-99b9-5ede371585cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:24 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2e495ea1-a015-415d-892b-f687d46e314b tempest-VolumesTransfersV357Test-865829522 None] Created volume successfully.
Jul 06 15:28:25 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11" returned: 0 in 1.683s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:25 devstack sudo[91026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11
Jul 06 15:28:25 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Acquiring lock "cinder-3cdef1a7-0e78-4ec3-996b-6d8563de44f7-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Lock "cinder-3cdef1a7-0e78-4ec3-996b-6d8563de44f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Acquiring lock "cinder-quobyte-3cdef1a7-0e78-4ec3-996b-6d8563de44f7" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Lock "cinder-quobyte-3cdef1a7-0e78-4ec3-996b-6d8563de44f7" acquired by "delete_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:25 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d99908-9236-4bad-ae3d-72733584bb31]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:25 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7
Jul 06 15:28:25 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:26 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.8e17ad90-87c9-4aae-b389-475dbbc8dd11" returned: 0 in 0.821s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-8e17ad90-87c9-4aae-b389-475dbbc8dd11" released by "_delete_snapshot" :: held 5.513s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" released by "delete_snapshot" :: held 5.571s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:26 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Created reservations ['8a6311c0-581f-46ab-b60d-a4f8cdca2338', '52a427b6-0bf9-4c84-85c2-c5971346943c', 'eb7b8a07-ab3e-4496-aba6-9019f0f15679', 'f7d397d8-dec0-4195-9b0d-e1da7fbbd190'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Delete snapshot completed successfully.
Jul 06 15:28:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-deefcfca-9b10-4691-91c9-76b8d5529d4e tempest-SnapshotsActionsTest-646741015 None] Lock "cinder-8e17ad90-87c9-4aae-b389-475dbbc8dd11-delete_snapshot" released by "delete_snapshot" :: held 5.761s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:26 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7" returned: 0 in 0.878s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:26 devstack sudo[91101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7
Jul 06 15:28:26 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:27 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cdef1a7-0e78-4ec3-996b-6d8563de44f7" returned: 0 in 0.946s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Lock "cinder-quobyte-3cdef1a7-0e78-4ec3-996b-6d8563de44f7" released by "delete_volume" :: held 1.891s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Created reservations ['3b4de358-affb-43f5-a8ed-b3b32ad5a357', 'a3d93957-0fd7-483f-8ab9-b6552cb50e71', 'c63497fe-52a1-46c0-bda2-355ccfec1782', '1faf39e5-6b1a-4d7b-bac6-830c0dc6e890'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "cinder-e844d874-3d89-4e4e-8525-98c9973a2d91-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Lock "cinder-e844d874-3d89-4e4e-8525-98c9973a2d91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "cinder-quobyte-e844d874-3d89-4e4e-8525-98c9973a2d91" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:27 devstack sudo[91124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Lock "cinder-quobyte-e844d874-3d89-4e4e-8525-98c9973a2d91" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:27 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Deleting offline snapshot e844d874-3d89-4e4e-8525-98c9973a2d91 of volume 0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] snapshot_file for this snap is: volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab18e74-136b-44fe-94d7-721374f6603c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:27 devstack sudo[91127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:28:27 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:28 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.912s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:28 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:28:28 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Deleted volume successfully.
Jul 06 15:28:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf87d155-fc07-4593-aea9-9670038d0374 tempest-VolumesTransfersV357Test-1108521940 None] Lock "cinder-3cdef1a7-0e78-4ec3-996b-6d8563de44f7-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:28 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 0.994s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:28:28 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f9288a-9baf-45c7-ad1a-8f12f8deee00]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:28 devstack sudo[91468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4
Jul 06 15:28:28 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:30 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" returned: 0 in 1.285s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:30 devstack sudo[91498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:28:30 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:31 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 1.253s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:31 devstack sudo[91525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91
Jul 06 15:28:31 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4.e844d874-3d89-4e4e-8525-98c9973a2d91" returned: 0 in 1.458s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:32 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:32 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Lock "cinder-quobyte-e844d874-3d89-4e4e-8525-98c9973a2d91" released by "_delete_snapshot" :: held 5.273s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:32 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" released by "delete_snapshot" :: held 5.329s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:32 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Created reservations ['d6db623f-ea35-4443-9fff-bad951b0dd68', '0d0bf7d1-a290-41e4-a6c8-9c06e25af233', '9563cc02-943e-413c-a9d9-92974fdf3468', '0e79f35e-27da-4e4d-b986-47f606746452'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Delete snapshot completed successfully.
Jul 06 15:28:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4ab55809-dbe9-4169-b3f3-303f79b81c68 tempest-SnapshotsActionsTest-1246980254 None] Lock "cinder-e844d874-3d89-4e4e-8525-98c9973a2d91-delete_snapshot" released by "delete_snapshot" :: held 5.584s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "cinder-0d9cf422-c100-4ac5-ad13-8c64d109e6f4-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Lock "cinder-0d9cf422-c100-4ac5-ad13-8c64d109e6f4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" acquired by "delete_volume" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:34 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[767c4dfe-939f-41ea-a291-dbf5326b075a]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:34 devstack sudo[91532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4
Jul 06 15:28:34 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:36 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" returned: 0 in 1.623s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:36 devstack sudo[91553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4
Jul 06 15:28:36 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:37 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" returned: 0 in 1.021s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Lock "cinder-quobyte-0d9cf422-c100-4ac5-ad13-8c64d109e6f4" released by "delete_volume" :: held 2.764s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:37 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Created reservations ['32d299ab-de04-4ca2-ab70-026e04a0d517', '397718ef-6e4a-48c5-9a00-c983f3807e0c', 'ea90e208-e964-4fa5-bdfe-37db5e41d988', '483915fb-896a-4bbd-9a6d-95e6a6d14fb9'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:37 devstack sudo[91576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:28:37 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:38 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.418s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:38 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:28:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Deleted volume successfully.
Jul 06 15:28:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9fac2056-bf28-44c8-acf9-229578edde12 tempest-SnapshotsActionsTest-1246980254 None] Lock "cinder-0d9cf422-c100-4ac5-ad13-8c64d109e6f4-delete_volume" released by "delete_volume" :: held 4.517s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Flow 'volume_create_manager' (57666a06-dc12-45e1-8859-090e7e78a129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b44039-6664-4107-beb4-69b12ad00490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b44039-6664-4107-beb4-69b12ad00490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1957045041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17c12ae9368f41aaa8cb156b2a6703cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:43Z,use_quota=True,user_id='8b8a88e582af4de49db94e573877cfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1267f322-8315-4420-acc4-9a7b982faad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1267f322-8315-4420-acc4-9a7b982faad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508eb53c-add3-4551-ae3d-ea41ec0c8d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508eb53c-add3-4551-ae3d-ea41ec0c8d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34', 'volume_name': 'volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25055313-db1a-4a5a-b54c-bf2a83ad626f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25055313-db1a-4a5a-b54c-bf2a83ad626f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991c953b-595b-42fd-8402-eae16726dea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:43 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Volume bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34', 'volume_size': 1}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1957045041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17c12ae9368f41aaa8cb156b2a6703cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:43Z,use_quota=True,user_id='8b8a88e582af4de49db94e573877cfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Creating volume bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:28:43 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:28:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:43 devstack sudo[91603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34 1073741824
Jul 06 15:28:43 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:44 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34 1073741824" returned: 0 in 1.212s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:44 devstack sudo[91638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34
Jul 06 15:28:44 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Flow 'volume_create_manager' (3d20627e-c639-4e3d-a019-f97c0dca996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a1b06a-6214-4d1d-ac97-8be3e441e3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a1b06a-6214-4d1d-ac97-8be3e441e3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1756995113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a82d89-4647-4136-97cd-521817e4ddc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570b4f36b3b34defbb4515fd24c91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:45Z,use_quota=True,user_id='de1c06c9ffca4a11a5bf8c9ceac21929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692bcdc4-2453-49c8-9f77-d4c950e4488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692bcdc4-2453-49c8-9f77-d4c950e4488d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fe9485-f612-4d02-8860-8f604cadcf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fe9485-f612-4d02-8860-8f604cadcf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a82d89-4647-4136-97cd-521817e4ddc0', 'volume_name': 'volume-f9a82d89-4647-4136-97cd-521817e4ddc0', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48514af0-9343-40c5-8c3c-4a357b74aaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48514af0-9343-40c5-8c3c-4a357b74aaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cef0fa1-dd1d-4069-b9bf-2750ec2ec05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:44 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Volume f9a82d89-4647-4136-97cd-521817e4ddc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a82d89-4647-4136-97cd-521817e4ddc0', 'volume_size': 1}
Jul 06 15:28:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:45 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34" returned: 0 in 0.719s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1756995113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a82d89-4647-4136-97cd-521817e4ddc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570b4f36b3b34defbb4515fd24c91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:45Z,use_quota=True,user_id='de1c06c9ffca4a11a5bf8c9ceac21929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Creating volume f9a82d89-4647-4136-97cd-521817e4ddc0 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:28:45 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991c953b-595b-42fd-8402-eae16726dea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5963ddab-95d9-413d-9042-ba31ca857d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:45 devstack sudo[91641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0 1073741824
Jul 06 15:28:45 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:45 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Volume volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34 (bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34): created successfully
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5963ddab-95d9-413d-9042-ba31ca857d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Flow 'volume_create_manager' (57666a06-dc12-45e1-8859-090e7e78a129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:45 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f4bed3b1-9853-4e70-8005-5a5ab9af9229 tempest-VolumesListTestJSON-1587857948 None] Created volume successfully.
Jul 06 15:28:46 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0 1073741824" returned: 0 in 0.793s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:46 devstack sudo[91670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0
Jul 06 15:28:46 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:46 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0" returned: 0 in 0.671s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:28:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cef0fa1-dd1d-4069-b9bf-2750ec2ec05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a82d89-4647-4136-97cd-521817e4ddc0', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63d62dd-6636-477d-af19-c9839a64ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:46 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Volume volume-f9a82d89-4647-4136-97cd-521817e4ddc0 (f9a82d89-4647-4136-97cd-521817e4ddc0): created successfully
Jul 06 15:28:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63d62dd-6636-477d-af19-c9839a64ae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Flow 'volume_create_manager' (3d20627e-c639-4e3d-a019-f97c0dca996e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-de22f027-fbdc-4050-9bab-f3083c00feeb tempest-ServersNegativeTestJSON-1702078537 None] Created volume successfully.
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Flow 'volume_create_manager' (148fa075-4a7f-490d-b23a-f17917c8131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6afeed-6d97-4db3-8a72-1749d4157c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6afeed-6d97-4db3-8a72-1749d4157c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1204325499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015e5731-3610-4da6-a9d6-aa0f3ba6f568,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17c12ae9368f41aaa8cb156b2a6703cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:47Z,use_quota=True,user_id='8b8a88e582af4de49db94e573877cfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc41a82-4a4c-4550-a465-58ee24904a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc41a82-4a4c-4550-a465-58ee24904a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e55a72-4443-402a-9063-e6bc8c9f8cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e55a72-4443-402a-9063-e6bc8c9f8cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015e5731-3610-4da6-a9d6-aa0f3ba6f568', 'volume_name': 'volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0be146-6e14-4a52-b158-6c7d50ae1220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0be146-6e14-4a52-b158-6c7d50ae1220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ea1826-f83c-4fc2-b1b6-7597aa776c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:47 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Volume 015e5731-3610-4da6-a9d6-aa0f3ba6f568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568', 'volume_size': 1}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1204325499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015e5731-3610-4da6-a9d6-aa0f3ba6f568,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17c12ae9368f41aaa8cb156b2a6703cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:47Z,use_quota=True,user_id='8b8a88e582af4de49db94e573877cfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Creating volume 015e5731-3610-4da6-a9d6-aa0f3ba6f568 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:28:47 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:28:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:47 devstack sudo[91673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568 1073741824
Jul 06 15:28:47 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:48 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568 1073741824" returned: 0 in 0.902s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:48 devstack sudo[91679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568
Jul 06 15:28:48 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:48 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568" returned: 0 in 0.683s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:28:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ea1826-f83c-4fc2-b1b6-7597aa776c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484146ee-8b6c-4478-8124-f47c59759db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:48 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Volume volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568 (015e5731-3610-4da6-a9d6-aa0f3ba6f568): created successfully
Jul 06 15:28:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484146ee-8b6c-4478-8124-f47c59759db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Flow 'volume_create_manager' (148fa075-4a7f-490d-b23a-f17917c8131f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-39833ad3-a2eb-445a-bda5-61db0b6a148e tempest-VolumesListTestJSON-1587857948 None] Created volume successfully.
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Flow 'volume_create_manager' (4d11b84a-d062-4f72-8a3e-8812a47f8563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9027d6cf-0566-421d-bad9-a30c1d20969b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9027d6cf-0566-421d-bad9-a30c1d20969b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1879783854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650e441c-970d-4d19-b57e-c367e759b91f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570b4f36b3b34defbb4515fd24c91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:49Z,use_quota=True,user_id='de1c06c9ffca4a11a5bf8c9ceac21929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceee13c-376f-44a4-97c6-977c30f75d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceee13c-376f-44a4-97c6-977c30f75d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956a36ef-3d42-4bbd-b28d-bf516c5a47e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956a36ef-3d42-4bbd-b28d-bf516c5a47e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650e441c-970d-4d19-b57e-c367e759b91f', 'volume_name': 'volume-650e441c-970d-4d19-b57e-c367e759b91f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0192d1-ea8e-4cdc-9a94-18e99b37b5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0192d1-ea8e-4cdc-9a94-18e99b37b5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9961c577-0138-4c16-8fbf-809c495ae514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:49 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Volume 650e441c-970d-4d19-b57e-c367e759b91f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650e441c-970d-4d19-b57e-c367e759b91f', 'volume_size': 1}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1879783854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650e441c-970d-4d19-b57e-c367e759b91f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570b4f36b3b34defbb4515fd24c91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:49Z,use_quota=True,user_id='de1c06c9ffca4a11a5bf8c9ceac21929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Creating volume 650e441c-970d-4d19-b57e-c367e759b91f {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:28:49 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:49 devstack sudo[91682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f 1073741824
Jul 06 15:28:49 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Flow 'volume_create_manager' (a69dc2d0-ecfc-4c03-acca-0d9692f71c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c1f8be-dd0f-49ba-aec1-1543f4b64fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c1f8be-dd0f-49ba-aec1-1543f4b64fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-172631391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19443faa-abc9-4e91-8ca1-4c726c9dc915,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17c12ae9368f41aaa8cb156b2a6703cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:50Z,use_quota=True,user_id='8b8a88e582af4de49db94e573877cfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f442aee-4e81-4bdd-aae2-6305d8e8195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f442aee-4e81-4bdd-aae2-6305d8e8195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d00d65f-d0f1-469d-b0b7-15f507f3526b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d00d65f-d0f1-469d-b0b7-15f507f3526b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19443faa-abc9-4e91-8ca1-4c726c9dc915', 'volume_name': 'volume-19443faa-abc9-4e91-8ca1-4c726c9dc915', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7ec832-6553-441a-b0c7-0a725c54d85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7ec832-6553-441a-b0c7-0a725c54d85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a15d4e-da57-4f95-94c5-1b788b1f0380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:49 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Volume 19443faa-abc9-4e91-8ca1-4c726c9dc915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19443faa-abc9-4e91-8ca1-4c726c9dc915', 'volume_size': 1}
Jul 06 15:28:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:50 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f 1073741824" returned: 0 in 0.946s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:50 devstack sudo[91690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f
Jul 06 15:28:50 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:50 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f" returned: 0 in 0.679s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-172631391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19443faa-abc9-4e91-8ca1-4c726c9dc915,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17c12ae9368f41aaa8cb156b2a6703cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:50Z,use_quota=True,user_id='8b8a88e582af4de49db94e573877cfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Creating volume 19443faa-abc9-4e91-8ca1-4c726c9dc915 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:28:50 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:50 devstack sudo[91693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915 1073741824
Jul 06 15:28:50 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9961c577-0138-4c16-8fbf-809c495ae514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650e441c-970d-4d19-b57e-c367e759b91f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bf033a-0fe7-4ed5-9aeb-0cbb983a2d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:50 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Volume volume-650e441c-970d-4d19-b57e-c367e759b91f (650e441c-970d-4d19-b57e-c367e759b91f): created successfully
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bf033a-0fe7-4ed5-9aeb-0cbb983a2d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Flow 'volume_create_manager' (4d11b84a-d062-4f72-8a3e-8812a47f8563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:50 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-72433fe6-4b83-47cb-ab97-0568ec1d132a tempest-ServersNegativeTestJSON-1702078537 None] Created volume successfully.
Jul 06 15:28:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Acquiring lock "cinder-650e441c-970d-4d19-b57e-c367e759b91f-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Lock "cinder-650e441c-970d-4d19-b57e-c367e759b91f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Acquiring lock "cinder-quobyte-650e441c-970d-4d19-b57e-c367e759b91f" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Lock "cinder-quobyte-650e441c-970d-4d19-b57e-c367e759b91f" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:51 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915 1073741824" returned: 0 in 0.918s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:51 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40f0e7f-8a20-44e1-a040-b151c3a82475]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:51 devstack sudo[91700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915
Jul 06 15:28:51 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:51 devstack sudo[91699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f
Jul 06 15:28:51 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:52 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915" returned: 0 in 0.705s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:28:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a15d4e-da57-4f95-94c5-1b788b1f0380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19443faa-abc9-4e91-8ca1-4c726c9dc915', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:52 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc9e982-43b3-466f-8c45-ccaad3d89c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:28:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f" returned: 0 in 0.789s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Volume volume-19443faa-abc9-4e91-8ca1-4c726c9dc915 (19443faa-abc9-4e91-8ca1-4c726c9dc915): created successfully
Jul 06 15:28:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc9e982-43b3-466f-8c45-ccaad3d89c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:28:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Flow 'volume_create_manager' (a69dc2d0-ecfc-4c03-acca-0d9692f71c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:28:52 devstack sudo[91708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f
Jul 06 15:28:52 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:52 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bf6c3b14-7ac3-4261-ac2b-9242402aa8c0 tempest-VolumesListTestJSON-1587857948 None] Created volume successfully.
Jul 06 15:28:53 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-650e441c-970d-4d19-b57e-c367e759b91f" returned: 0 in 0.851s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:53 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Lock "cinder-quobyte-650e441c-970d-4d19-b57e-c367e759b91f" released by "delete_volume" :: held 1.694s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:53 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Created reservations ['4b6a13a6-72b1-4e80-89e4-1361f28deac2', '0bcdc263-8b76-4885-aa8b-b310d2f59385', '6e488710-64f4-4c47-ba0c-e8b65ceaaa93', 'ca6733ea-09ca-4a22-9b4e-cf50cf33ecc9'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:53 devstack sudo[91712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:28:53 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Acquiring lock "cinder-f9a82d89-4647-4136-97cd-521817e4ddc0-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Lock "cinder-f9a82d89-4647-4136-97cd-521817e4ddc0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Acquiring lock "cinder-quobyte-f9a82d89-4647-4136-97cd-521817e4ddc0" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Lock "cinder-quobyte-f9a82d89-4647-4136-97cd-521817e4ddc0" acquired by "delete_volume" :: waited 0.036s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:54 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[decf90f9-8601-4fa9-9b58-213eef3b6f21]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:54 devstack sudo[91714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0
Jul 06 15:28:54 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:54 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.097s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:54 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:28:54 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Deleted volume successfully.
Jul 06 15:28:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16663c7f-4077-4aa6-a4b3-4d7179271a86 tempest-ServersNegativeTestJSON-1702078537 None] Lock "cinder-650e441c-970d-4d19-b57e-c367e759b91f-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:55 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0" returned: 0 in 1.109s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:55 devstack sudo[91720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0
Jul 06 15:28:55 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "cinder-19443faa-abc9-4e91-8ca1-4c726c9dc915-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-19443faa-abc9-4e91-8ca1-4c726c9dc915-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=98,cinder:INSERT=23,cinder:UPDATE=96,cinder:DELETE=9 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=80,cinder:INSERT=28,cinder:UPDATE=107,cinder:DELETE=7 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "cinder-quobyte-19443faa-abc9-4e91-8ca1-4c726c9dc915" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:56 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f9a82d89-4647-4136-97cd-521817e4ddc0" returned: 0 in 0.775s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-quobyte-19443faa-abc9-4e91-8ca1-4c726c9dc915" acquired by "delete_volume" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Lock "cinder-quobyte-f9a82d89-4647-4136-97cd-521817e4ddc0" released by "delete_volume" :: held 1.968s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[370489a1-b044-49f3-98fe-80bfe8ceca8c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Created reservations ['38ec0cfa-48bb-4fbf-8818-cc2e72a48915', 'dd9b9568-54bc-4a3c-a3da-1c397653b48c', 'b93cb834-06ea-4ae6-9934-05f4c1942167', 'a131112b-9d9e-4561-8d55-3da509b9eec0'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:56 devstack sudo[91723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915
Jul 06 15:28:56 devstack sudo[91723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:56 devstack sudo[91725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:28:56 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:57 devstack sudo[91723]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915" returned: 0 in 1.243s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:57 devstack sudo[91731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915
Jul 06 15:28:57 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:57 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.237s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:57 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:28:57 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Deleted volume successfully.
Jul 06 15:28:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b90566b6-88a0-438d-8407-b8ab9abd9a7d tempest-ServersNegativeTestJSON-1702078537 None] Lock "cinder-f9a82d89-4647-4136-97cd-521817e4ddc0-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:58 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19443faa-abc9-4e91-8ca1-4c726c9dc915" returned: 0 in 0.660s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-quobyte-19443faa-abc9-4e91-8ca1-4c726c9dc915" released by "delete_volume" :: held 1.946s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Created reservations ['aa436302-3dc5-40fc-a1a8-b38e59351ca0', 'af95cd65-4c8f-4ae9-b777-977512f1f976', '7f6b29dc-9df7-4b96-8dc1-fede99bd58ad', '19d78b03-afb4-405b-a71d-0a842b85a11b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:58 devstack sudo[91740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:28:58 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "cinder-015e5731-3610-4da6-a9d6-aa0f3ba6f568-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-015e5731-3610-4da6-a9d6-aa0f3ba6f568-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "cinder-quobyte-015e5731-3610-4da6-a9d6-aa0f3ba6f568" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-quobyte-015e5731-3610-4da6-a9d6-aa0f3ba6f568" acquired by "delete_volume" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[243bc12e-7f3f-468d-8ff0-7e9d10e489c9]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:28:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:58 devstack sudo[91748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568
Jul 06 15:28:58 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:28:59 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.950s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:59 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:28:59 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Deleted volume successfully.
Jul 06 15:28:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81d6281d-e993-4718-82e8-a3dde6ed6f70 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-19443faa-abc9-4e91-8ca1-4c726c9dc915-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:28:59 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root
Jul 06 15:28:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568" returned: 0 in 1.097s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:28:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:28:59 devstack sudo[91768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568
Jul 06 15:28:59 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:00 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-015e5731-3610-4da6-a9d6-aa0f3ba6f568" returned: 0 in 0.763s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-quobyte-015e5731-3610-4da6-a9d6-aa0f3ba6f568" released by "delete_volume" :: held 1.952s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Created reservations ['98ad4244-3cd5-4e53-9a44-3797b9c64044', '2c2fbb68-8be2-4e71-a107-7a171e3cd13c', 'a2f4d337-f663-4309-aac6-3a4df08cbcbc', '5a2e2a31-09ff-4fde-bf9a-fcfe27ecc8ac'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:00 devstack sudo[91773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:29:00 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "cinder-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "cinder-quobyte-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-quobyte-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[016b5d7b-96da-47c1-96a5-7e5232e3aace]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:29:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:00 devstack sudo[91775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34
Jul 06 15:29:00 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:01 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.816s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:01 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:29:01 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Deleted volume successfully.
Jul 06 15:29:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4799c97f-2459-4976-8e0a-e417e81aa914 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-015e5731-3610-4da6-a9d6-aa0f3ba6f568-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:29:01 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34" returned: 0 in 0.887s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:01 devstack sudo[91818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34
Jul 06 15:29:01 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:02 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34" returned: 0 in 0.690s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-quobyte-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34" released by "delete_volume" :: held 1.623s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:29:02 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Created reservations ['2dcc88f7-9ad2-4f06-ae46-390f02d3c4f5', 'ecfeeb37-927f-415a-a811-43b7960d1bdc', 'c1120763-f2e9-489b-aa83-27ec3c5fd096', '1e8be09a-fac8-4683-aa3b-3d7325647c5c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:29:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:29:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:29:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:02 devstack sudo[91821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:29:02 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:03 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.789s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:03 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:29:03 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Deleted volume successfully.
Jul 06 15:29:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba902fd4-117b-4799-8a4a-14c526809821 tempest-VolumesListTestJSON-1587857948 None] Lock "cinder-bee09a4d-0f01-4d2f-bb3e-3367bcd9ab34-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:29:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:29:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:29:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:29:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:06 devstack sudo[91825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:29:06 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:07 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.803s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:29:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:29:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 8 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:29:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Flow 'volume_create_manager' (1f1eac8e-7add-45fd-b9dc-d971eff8c682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81605e07-3511-4234-a3a8-62a3f5af848e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81605e07-3511-4234-a3a8-62a3f5af848e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1373706046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1378433e-2072-4432-8df7-88b3a5e27fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9976d11d8b604f96a14f5c98fee0a585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:10Z,use_quota=True,user_id='f2ac576761314b8f965bcab4144ecad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64092879-6051-4f4a-a949-e0521598b48e),volume_type_id=64092879-6051-4f4a-a949-e0521598b48e)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80565d13-0ea9-4073-b37b-98701673a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80565d13-0ea9-4073-b37b-98701673a77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d244e1-4562-4717-96c6-3ee6f5b0226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d244e1-4562-4717-96c6-3ee6f5b0226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1378433e-2072-4432-8df7-88b3a5e27fe1', 'volume_name': 'volume-1378433e-2072-4432-8df7-88b3a5e27fe1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a27c7e-e437-462d-a953-70e814db5336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a27c7e-e437-462d-a953-70e814db5336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da476801-82a6-4162-a8e4-5eaea28419ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:09 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Volume 1378433e-2072-4432-8df7-88b3a5e27fe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1378433e-2072-4432-8df7-88b3a5e27fe1', 'volume_size': 1}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1373706046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1378433e-2072-4432-8df7-88b3a5e27fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9976d11d8b604f96a14f5c98fee0a585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:10Z,use_quota=True,user_id='f2ac576761314b8f965bcab4144ecad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64092879-6051-4f4a-a949-e0521598b48e),volume_type_id=64092879-6051-4f4a-a949-e0521598b48e)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Creating volume 1378433e-2072-4432-8df7-88b3a5e27fe1 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:29:09 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:29:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:09 devstack sudo[91836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1 1073741824
Jul 06 15:29:09 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:10 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-bb018bc8-53fe-4812-a476-3e4dc30e2be6 req-c2e575af-d22f-4940-92f0-245b40b95dd0 tempest-ServerActionsTestOtherA-1377191639 None] Terminate volume connection completed successfully.
Jul 06 15:29:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-bb018bc8-53fe-4812-a476-3e4dc30e2be6 req-c2e575af-d22f-4940-92f0-245b40b95dd0 tempest-ServerActionsTestOtherA-1377191639 None] Deleting attachment 88c107ff-5ec3-42be-80aa-1cbdc9a6dce0. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:29:10 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1 1073741824" returned: 0 in 1.018s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:10 devstack sudo[91846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1
Jul 06 15:29:10 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:11 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1" returned: 0 in 0.701s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:29:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da476801-82a6-4162-a8e4-5eaea28419ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1378433e-2072-4432-8df7-88b3a5e27fe1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d336a7e-f761-416e-8ab0-a10f42230cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:11 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Volume volume-1378433e-2072-4432-8df7-88b3a5e27fe1 (1378433e-2072-4432-8df7-88b3a5e27fe1): created successfully
Jul 06 15:29:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d336a7e-f761-416e-8ab0-a10f42230cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Flow 'volume_create_manager' (1f1eac8e-7add-45fd-b9dc-d971eff8c682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:29:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a3fcf794-1030-467f-91fa-f631f5e71064 tempest-VolumeTypesAccessTest-1251932479 None] Created volume successfully.
Jul 06 15:29:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Acquiring lock "cinder-1378433e-2072-4432-8df7-88b3a5e27fe1-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:29:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Lock "cinder-1378433e-2072-4432-8df7-88b3a5e27fe1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:29:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Acquiring lock "cinder-quobyte-1378433e-2072-4432-8df7-88b3a5e27fe1" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:29:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Lock "cinder-quobyte-1378433e-2072-4432-8df7-88b3a5e27fe1" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:29:12 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fa5184-087f-4444-b8b5-d05c6501637c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:29:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:12 devstack sudo[91849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1
Jul 06 15:29:12 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:13 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1" returned: 0 in 1.079s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:13 devstack sudo[91855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1
Jul 06 15:29:13 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:13 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1378433e-2072-4432-8df7-88b3a5e27fe1" returned: 0 in 0.713s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Lock "cinder-quobyte-1378433e-2072-4432-8df7-88b3a5e27fe1" released by "delete_volume" :: held 1.856s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:29:13 devstack cinder-volume[86249]: WARNING cinder.quota [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-682969574 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-682969574, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:29:13 devstack cinder-volume[86249]: WARNING cinder.quota [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-682969574 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-682969574, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:29:13 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Created reservations ['32caebe3-a9e2-491b-aae8-78f44b7f05b3', '2e008b5c-bd08-4006-916b-edb109a60a43', 'b954fbe0-7d23-44b6-82fe-d1cc8d3cf6ce', '9a988ae3-e749-4f7c-8b51-0defe117a463'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:29:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:29:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:29:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:14 devstack sudo[91864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:29:14 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:15 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.997s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:15 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:29:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Deleted volume successfully.
Jul 06 15:29:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d4200844-2354-4078-b15e-491979ed91bd tempest-VolumeTypesAccessTest-1251932479 None] Lock "cinder-1378433e-2072-4432-8df7-88b3a5e27fe1-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:29:24 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=27,cinder:INSERT=9,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:29:25 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=26,cinder:INSERT=12,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:29:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Acquiring lock "cinder-f20b2b3d-b7eb-4202-b34e-c7d088ec089a-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:29:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Lock "cinder-f20b2b3d-b7eb-4202-b34e-c7d088ec089a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:29:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Acquiring lock "cinder-quobyte-f20b2b3d-b7eb-4202-b34e-c7d088ec089a" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:29:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Lock "cinder-quobyte-f20b2b3d-b7eb-4202-b34e-c7d088ec089a" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:29:25 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e95aa5-e885-48a7-9a5c-7022c5017732]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:29:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:25 devstack sudo[91899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a
Jul 06 15:29:25 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:26 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a" returned: 0 in 0.854s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:26 devstack sudo[91904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a
Jul 06 15:29:26 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:27 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f20b2b3d-b7eb-4202-b34e-c7d088ec089a" returned: 0 in 0.851s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Lock "cinder-quobyte-f20b2b3d-b7eb-4202-b34e-c7d088ec089a" released by "delete_volume" :: held 1.761s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:29:27 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Created reservations ['9375f432-60e4-479c-8bd6-c657bfa34b7c', '3c2a5548-dad3-41ae-a8e0-bb90f387fbe1', '70c86cc0-58eb-47cf-90eb-26627066d5b5', '10bcd765-4e40-432d-8065-e88db9faa35b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:29:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:29:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:29:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:27 devstack sudo[91907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:29:27 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:28 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.956s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:28 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:29:28 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Deleted volume successfully.
Jul 06 15:29:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43dd89b6-dc22-4168-86f3-3653cbe0ed11 tempest-ServerActionsTestOtherA-1377191639 None] Lock "cinder-f20b2b3d-b7eb-4202-b34e-c7d088ec089a-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:29:43 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:29:43 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Flow 'volume_create_manager' (e17db25e-7428-4cb7-be92-acb7ef2391ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64b74e2-60ce-46e7-96e6-7b42ccb87ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64b74e2-60ce-46e7-96e6-7b42ccb87ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-321554505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cdf223-424f-47c5-a8dd-fc9a4b789329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769395f5c5854bb9a3c60cbdee9f9a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:45Z,use_quota=True,user_id='b816fc51326a46fb9c68c59692ae74ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b303e3d0-d4d2-4896-a241-754732263ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b303e3d0-d4d2-4896-a241-754732263ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb5cdef-b5ac-4feb-913a-b411ccc72da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb5cdef-b5ac-4feb-913a-b411ccc72da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cdf223-424f-47c5-a8dd-fc9a4b789329', 'volume_name': 'volume-55cdf223-424f-47c5-a8dd-fc9a4b789329', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505eeabf-9a22-486c-bda8-1ab3f41bafb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505eeabf-9a22-486c-bda8-1ab3f41bafb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eff6ae4-a211-4ff3-b606-d62ac07a0d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:45 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Volume 55cdf223-424f-47c5-a8dd-fc9a4b789329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cdf223-424f-47c5-a8dd-fc9a4b789329', 'volume_size': 1}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-321554505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cdf223-424f-47c5-a8dd-fc9a4b789329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769395f5c5854bb9a3c60cbdee9f9a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:45Z,use_quota=True,user_id='b816fc51326a46fb9c68c59692ae74ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Creating volume 55cdf223-424f-47c5-a8dd-fc9a4b789329 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:29:45 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:29:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:45 devstack sudo[92018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329 1073741824
Jul 06 15:29:45 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:46 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329 1073741824" returned: 0 in 0.993s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:46 devstack sudo[92043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329
Jul 06 15:29:46 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:47 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329" returned: 0 in 0.802s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:29:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eff6ae4-a211-4ff3-b606-d62ac07a0d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cdf223-424f-47c5-a8dd-fc9a4b789329', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4085ea3-a607-4ab2-9151-f44cc5a002b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:47 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Volume volume-55cdf223-424f-47c5-a8dd-fc9a4b789329 (55cdf223-424f-47c5-a8dd-fc9a4b789329): created successfully
Jul 06 15:29:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4085ea3-a607-4ab2-9151-f44cc5a002b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Flow 'volume_create_manager' (e17db25e-7428-4cb7-be92-acb7ef2391ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:29:47 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fbb169a5-2d1e-47f9-8ba7-142e5ac6f884 tempest-VolumesListAdminTestJSON-3155512 None] Created volume successfully.
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Flow 'volume_create_manager' (bec8b0bd-e7b1-4111-8ddf-09af401905bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf1dab8-4964-46d4-b0d7-68c56bf92765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf1dab8-4964-46d4-b0d7-68c56bf92765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1158113471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a65db44-d8a8-440c-b58e-6eccf0669399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769395f5c5854bb9a3c60cbdee9f9a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:49Z,use_quota=True,user_id='b816fc51326a46fb9c68c59692ae74ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c91f80-2af2-4f60-a469-4adc9f5b86f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c91f80-2af2-4f60-a469-4adc9f5b86f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36898cd6-84ba-4a07-95f3-b812120feedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36898cd6-84ba-4a07-95f3-b812120feedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a65db44-d8a8-440c-b58e-6eccf0669399', 'volume_name': 'volume-3a65db44-d8a8-440c-b58e-6eccf0669399', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c368ae-5cd9-4d71-8a6c-d770c4c42ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c368ae-5cd9-4d71-8a6c-d770c4c42ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e04db9-e752-4902-b532-5eb96cc9faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:49 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Volume 3a65db44-d8a8-440c-b58e-6eccf0669399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a65db44-d8a8-440c-b58e-6eccf0669399', 'volume_size': 1}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1158113471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a65db44-d8a8-440c-b58e-6eccf0669399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769395f5c5854bb9a3c60cbdee9f9a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:49Z,use_quota=True,user_id='b816fc51326a46fb9c68c59692ae74ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Creating volume 3a65db44-d8a8-440c-b58e-6eccf0669399 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:29:49 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:29:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:49 devstack sudo[92050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399 1073741824
Jul 06 15:29:49 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:51 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399 1073741824" returned: 0 in 1.750s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:51 devstack sudo[92071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399
Jul 06 15:29:51 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:52 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399" returned: 0 in 1.044s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] <== create_volume: return (2896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:29:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.900s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e04db9-e752-4902-b532-5eb96cc9faad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a65db44-d8a8-440c-b58e-6eccf0669399', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ea8434-6990-4785-a728-c75b93205732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Volume volume-3a65db44-d8a8-440c-b58e-6eccf0669399 (3a65db44-d8a8-440c-b58e-6eccf0669399): created successfully
Jul 06 15:29:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ea8434-6990-4785-a728-c75b93205732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Flow 'volume_create_manager' (bec8b0bd-e7b1-4111-8ddf-09af401905bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:29:52 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9c71f004-ac2f-4a2b-82f1-70c978782c21 tempest-VolumesListAdminTestJSON-3155512 None] Created volume successfully.
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Flow 'volume_create_manager' (433c1aea-469c-4f39-85b1-b650ee6ed323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa49321b-2781-48f6-94db-d9bdaed6b689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa49321b-2781-48f6-94db-d9bdaed6b689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1553541611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff60f2e5-dcda-4d12-8df7-66a0f968df66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769395f5c5854bb9a3c60cbdee9f9a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:53Z,use_quota=True,user_id='b816fc51326a46fb9c68c59692ae74ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212b5172-1b19-449e-86ba-7fefbb824475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212b5172-1b19-449e-86ba-7fefbb824475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474c0352-4d0a-4aef-ac83-2c6cf63d9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474c0352-4d0a-4aef-ac83-2c6cf63d9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff60f2e5-dcda-4d12-8df7-66a0f968df66', 'volume_name': 'volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9707fd2-f21f-4087-ae03-2af1abbdc9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9707fd2-f21f-4087-ae03-2af1abbdc9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951b79a4-80b3-437c-96e9-05b6e16e521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:53 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Volume ff60f2e5-dcda-4d12-8df7-66a0f968df66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66', 'volume_size': 1}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1553541611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff60f2e5-dcda-4d12-8df7-66a0f968df66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769395f5c5854bb9a3c60cbdee9f9a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:53Z,use_quota=True,user_id='b816fc51326a46fb9c68c59692ae74ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Creating volume ff60f2e5-dcda-4d12-8df7-66a0f968df66 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:29:53 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:29:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:53 devstack sudo[92079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66 1073741824
Jul 06 15:29:53 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:54 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66 1073741824" returned: 0 in 1.279s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:55 devstack sudo[92086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66
Jul 06 15:29:55 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:56 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66" returned: 0 in 1.089s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] <== create_volume: return (2429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:29:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.431s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951b79a4-80b3-437c-96e9-05b6e16e521f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3918219-6d30-46bb-9daa-79c889137d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:56 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Volume volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66 (ff60f2e5-dcda-4d12-8df7-66a0f968df66): created successfully
Jul 06 15:29:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3918219-6d30-46bb-9daa-79c889137d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Flow 'volume_create_manager' (433c1aea-469c-4f39-85b1-b650ee6ed323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:29:56 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1419b058-e931-4c89-ab41-1f2221c7789d tempest-VolumesListAdminTestJSON-3155512 None] Created volume successfully.
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Flow 'volume_create_manager' (86f68c76-dc43-4ce3-8662-ac516e147b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914970d2-12b6-49de-b4c8-88bfb91efc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914970d2-12b6-49de-b4c8-88bfb91efc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2e4e64-f995-4ee8-845b-14c13e0a2931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736bf48c715e4d8fbfcd879d7cd60f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:58Z,use_quota=True,user_id='b05e82f269a840a8b3060ecdc7d74d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fd7db5-7263-403f-acd1-15ca1d853681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fd7db5-7263-403f-acd1-15ca1d853681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83e5471-b342-4142-8835-50f2591016c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83e5471-b342-4142-8835-50f2591016c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2e4e64-f995-4ee8-845b-14c13e0a2931', 'volume_name': 'volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96b85b5-b0a2-4c67-a405-dfa2c21837fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96b85b5-b0a2-4c67-a405-dfa2c21837fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f835804b-aead-475c-aab6-f9e44064a287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:29:58 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Volume 6a2e4e64-f995-4ee8-845b-14c13e0a2931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931', 'volume_size': 1}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2e4e64-f995-4ee8-845b-14c13e0a2931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736bf48c715e4d8fbfcd879d7cd60f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:58Z,use_quota=True,user_id='b05e82f269a840a8b3060ecdc7d74d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Creating volume 6a2e4e64-f995-4ee8-845b-14c13e0a2931 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:29:58 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:29:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:58 devstack sudo[92124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931 1073741824
Jul 06 15:29:58 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:29:59 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root
Jul 06 15:29:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931 1073741824" returned: 0 in 1.545s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:29:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:29:59 devstack sudo[92184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931
Jul 06 15:29:59 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:00 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931" returned: 0 in 0.718s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:30:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.368s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f835804b-aead-475c-aab6-f9e44064a287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ca2899-a585-41b7-9b62-2519092fd4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:00 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Volume volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931 (6a2e4e64-f995-4ee8-845b-14c13e0a2931): created successfully
Jul 06 15:30:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ca2899-a585-41b7-9b62-2519092fd4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Flow 'volume_create_manager' (86f68c76-dc43-4ce3-8662-ac516e147b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:00 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f6b9a293-79c4-427e-878e-761ab12624e8 tempest-VolumesListAdminTestJSON-2025292015 None] Created volume successfully.
Jul 06 15:30:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Acquiring lock "cinder-6a2e4e64-f995-4ee8-845b-14c13e0a2931-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Lock "cinder-6a2e4e64-f995-4ee8-845b-14c13e0a2931-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Acquiring lock "cinder-quobyte-6a2e4e64-f995-4ee8-845b-14c13e0a2931" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Lock "cinder-quobyte-6a2e4e64-f995-4ee8-845b-14c13e0a2931" acquired by "delete_volume" :: waited 0.038s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:01 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b975e-1896-4ed3-9c68-e4af3445d118]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "cinder-ff60f2e5-dcda-4d12-8df7-66a0f968df66-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-ff60f2e5-dcda-4d12-8df7-66a0f968df66-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "cinder-quobyte-ff60f2e5-dcda-4d12-8df7-66a0f968df66" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-quobyte-ff60f2e5-dcda-4d12-8df7-66a0f968df66" acquired by "delete_volume" :: waited 0.058s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:02 devstack sudo[92212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931
Jul 06 15:30:02 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:02 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c3954e-af59-4761-94e4-d69c292b9750]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:02 devstack sudo[92229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66
Jul 06 15:30:02 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:03 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931" returned: 0 in 1.845s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:03 devstack sudo[92241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931
Jul 06 15:30:03 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:03 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66" returned: 0 in 1.708s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:03 devstack sudo[92243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66
Jul 06 15:30:03 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:04 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ff60f2e5-dcda-4d12-8df7-66a0f968df66" returned: 0 in 0.881s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:04 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-quobyte-ff60f2e5-dcda-4d12-8df7-66a0f968df66" released by "delete_volume" :: held 2.686s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a2e4e64-f995-4ee8-845b-14c13e0a2931" returned: 0 in 1.136s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Lock "cinder-quobyte-6a2e4e64-f995-4ee8-845b-14c13e0a2931" released by "delete_volume" :: held 3.071s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Created reservations ['f7c5ee06-51a5-4ae1-b8c3-07ebbc1b4aa4', '95746a2d-57cd-488b-acd4-a6eb2937306a', 'bfc08f8e-bd56-4701-ae25-ba97ec6be718', '27edb61d-01e8-4245-ab92-72e39285caf6'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Created reservations ['4017c58a-b14f-4be8-b16b-d1c68a511b75', '8a6a5f7a-438d-4948-b149-3b332f5b9975', '93a8891a-3cdc-4ded-8210-c485436a6636', '3716e045-9f74-4118-bdb2-c1335f74b4d3'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:05 devstack sudo[92247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:30:05 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:05 devstack sudo[92249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:30:05 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "cinder-3a65db44-d8a8-440c-b58e-6eccf0669399-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-3a65db44-d8a8-440c-b58e-6eccf0669399-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "cinder-quobyte-3a65db44-d8a8-440c-b58e-6eccf0669399" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-quobyte-3a65db44-d8a8-440c-b58e-6eccf0669399" acquired by "delete_volume" :: waited 0.065s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88e25eb-ddbe-434e-8d1f-2807b7024585]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:06 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.059s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:30:06 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Deleted volume successfully.
Jul 06 15:30:06 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a6abcb92-2d17-43ea-9a8f-203203f387c7 tempest-VolumesListAdminTestJSON-2025292015 None] Lock "cinder-6a2e4e64-f995-4ee8-845b-14c13e0a2931-delete_volume" released by "delete_volume" :: held 4.660s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.258s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:30:06 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Deleted volume successfully.
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5292558f-0cb8-4ac3-8622-e3162548b475 tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-ff60f2e5-dcda-4d12-8df7-66a0f968df66-delete_volume" released by "delete_volume" :: held 4.472s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:06 devstack sudo[92253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399
Jul 06 15:30:06 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:06 devstack sudo[92255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:30:06 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:07 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.936s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:30:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:30:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 8 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:30:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:30:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399" returned: 0 in 1.851s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:07 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:07 devstack sudo[92264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399
Jul 06 15:30:07 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:08 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3a65db44-d8a8-440c-b58e-6eccf0669399" returned: 0 in 1.022s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-quobyte-3a65db44-d8a8-440c-b58e-6eccf0669399" released by "delete_volume" :: held 2.960s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:08 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Created reservations ['9cfc6a1c-62e5-4607-8bd8-6f7859a5224e', '7f56fb08-0641-4e56-9469-7ffcbebb9ca2', '4c7147eb-53bc-4e1e-99c2-0ccdb2c713b4', 'f0bb9635-98ff-4696-af0a-f58a68d37b10'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:09 devstack sudo[92267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:30:09 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "cinder-55cdf223-424f-47c5-a8dd-fc9a4b789329-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-55cdf223-424f-47c5-a8dd-fc9a4b789329-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "cinder-quobyte-55cdf223-424f-47c5-a8dd-fc9a4b789329" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-quobyte-55cdf223-424f-47c5-a8dd-fc9a4b789329" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e703cdc4-84d7-4f87-845a-e0443e3ca1e4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:09 devstack sudo[92271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329
Jul 06 15:30:09 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:10 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.967s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:10 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:30:10 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Deleted volume successfully.
Jul 06 15:30:10 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a4b8822-a296-4db4-b6a3-d1b7d6cb90cc tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-3a65db44-d8a8-440c-b58e-6eccf0669399-delete_volume" released by "delete_volume" :: held 4.416s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:10 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329" returned: 0 in 0.896s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:10 devstack sudo[92278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329
Jul 06 15:30:10 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:11 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55cdf223-424f-47c5-a8dd-fc9a4b789329" returned: 0 in 0.730s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-quobyte-55cdf223-424f-47c5-a8dd-fc9a4b789329" released by "delete_volume" :: held 1.688s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:11 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Created reservations ['a5805a67-d6a0-4489-9c71-bc8dce5ffcb6', '8aba04de-79ce-42b0-80f7-8420c029590a', '268e3da0-7bed-4cab-a51e-67406b74cd11', 'da3e96e1-6c14-4864-874b-045d7cb12eae'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:30:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:11 devstack sudo[92284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:30:11 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:12 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.921s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:12 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:30:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Deleted volume successfully.
Jul 06 15:30:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1fd0e6e9-bdd9-4447-8dd0-eafc94dc38ed tempest-VolumesListAdminTestJSON-3155512 None] Lock "cinder-55cdf223-424f-47c5-a8dd-fc9a4b789329-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Flow 'volume_create_manager' (3d2ac276-1b11-4fb3-9ae7-55a30be37426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3289109-a09c-4847-97fa-43d63d174077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3289109-a09c-4847-97fa-43d63d174077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-797372727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040b5282-18c9-4994-bae3-7d877dfd2576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192cc68371824c069d4496f57cc0bf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:15Z,use_quota=True,user_id='fdf8018f0ce7405a98aec3d346e6c45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3976a6e-2191-4a99-971a-903152ee9260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3976a6e-2191-4a99-971a-903152ee9260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cae40c7-e438-4ac0-a0c2-88744e8d0c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cae40c7-e438-4ac0-a0c2-88744e8d0c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040b5282-18c9-4994-bae3-7d877dfd2576', 'volume_name': 'volume-040b5282-18c9-4994-bae3-7d877dfd2576', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f1e1e0-5795-4d01-bdba-b1c395aa445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f1e1e0-5795-4d01-bdba-b1c395aa445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4025a177-5d87-472b-a52b-ad95ffb051f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:14 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Volume 040b5282-18c9-4994-bae3-7d877dfd2576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040b5282-18c9-4994-bae3-7d877dfd2576', 'volume_size': 1}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-797372727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040b5282-18c9-4994-bae3-7d877dfd2576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192cc68371824c069d4496f57cc0bf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:15Z,use_quota=True,user_id='fdf8018f0ce7405a98aec3d346e6c45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Creating volume 040b5282-18c9-4994-bae3-7d877dfd2576 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:30:14 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:30:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:14 devstack sudo[92307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576 1073741824
Jul 06 15:30:14 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:15 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576 1073741824" returned: 0 in 0.807s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:15 devstack sudo[92313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576
Jul 06 15:30:15 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:16 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576" returned: 0 in 0.762s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:30:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4025a177-5d87-472b-a52b-ad95ffb051f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040b5282-18c9-4994-bae3-7d877dfd2576', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52061cc-b2f4-4ca1-9ce1-98a76c508193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:16 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Volume volume-040b5282-18c9-4994-bae3-7d877dfd2576 (040b5282-18c9-4994-bae3-7d877dfd2576): created successfully
Jul 06 15:30:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52061cc-b2f4-4ca1-9ce1-98a76c508193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Flow 'volume_create_manager' (3d2ac276-1b11-4fb3-9ae7-55a30be37426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:16 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5565bcfc-ea93-4bc4-b1c5-e38833411d0c tempest-AttachVolumeTestJSON-402367968 None] Created volume successfully.
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Flow 'volume_create_manager' (69d044f8-459d-4f9d-8954-50d38729d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b4a00a-e230-4b0d-9375-977cca971868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b4a00a-e230-4b0d-9375-977cca971868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-332298245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f70929a-79da-48d9-92ee-ebd30a13f7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70ebc598f8242deaa2b9d52ab61072c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:19Z,use_quota=True,user_id='d486a414b3ef4c3eb228a8dd2327b5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e28fed8-1dd0-4234-930e-15dbbaf007f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e28fed8-1dd0-4234-930e-15dbbaf007f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d63e3a5-20ba-4b7f-98c4-8782f91e534e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d63e3a5-20ba-4b7f-98c4-8782f91e534e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f70929a-79da-48d9-92ee-ebd30a13f7d6', 'volume_name': 'volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c52d86-a226-4d8a-bbdf-b4cebf61622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c52d86-a226-4d8a-bbdf-b4cebf61622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5658892b-decc-46e5-bf18-75ab6d009641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:19 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Volume 3f70929a-79da-48d9-92ee-ebd30a13f7d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6', 'volume_size': 1}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-332298245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f70929a-79da-48d9-92ee-ebd30a13f7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70ebc598f8242deaa2b9d52ab61072c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:19Z,use_quota=True,user_id='d486a414b3ef4c3eb228a8dd2327b5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Creating volume 3f70929a-79da-48d9-92ee-ebd30a13f7d6 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:30:19 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:19 devstack sudo[92339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 1073741824
Jul 06 15:30:19 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-8aba5285-4cf6-477b-8a25-ebcd5430b203 req-fcb5cae0-036c-49fe-a60c-e075c0f0e6d7 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:20 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 1073741824" returned: 0 in 0.997s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:20 devstack sudo[92353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6
Jul 06 15:30:20 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:21 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6" returned: 0 in 0.657s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:30:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-8aba5285-4cf6-477b-8a25-ebcd5430b203 req-fcb5cae0-036c-49fe-a60c-e075c0f0e6d7 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.402s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5658892b-decc-46e5-bf18-75ab6d009641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0015edb0-d4cc-4987-bd06-061effda3a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:21 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb201310-4c11-4c40-af12-4b2629556ba2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-8aba5285-4cf6-477b-8a25-ebcd5430b203 req-fcb5cae0-036c-49fe-a60c-e075c0f0e6d7 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:21 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Volume volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 (3f70929a-79da-48d9-92ee-ebd30a13f7d6): created successfully
Jul 06 15:30:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0015edb0-d4cc-4987-bd06-061effda3a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Flow 'volume_create_manager' (69d044f8-459d-4f9d-8954-50d38729d661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:21 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-541bc119-cd3e-42b8-b62f-027b691583a9 tempest-VolumesDeleteCascade-858340595 None] Created volume successfully.
Jul 06 15:30:21 devstack sudo[92356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576
Jul 06 15:30:21 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:22 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-8aba5285-4cf6-477b-8a25-ebcd5430b203 req-fcb5cae0-036c-49fe-a60c-e075c0f0e6d7 tempest-AttachVolumeTestJSON-402367968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576" returned: 0 in 1.302s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-8aba5285-4cf6-477b-8a25-ebcd5430b203 req-fcb5cae0-036c-49fe-a60c-e075c0f0e6d7 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.327s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.380s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Creating offline snapshot 78575941-7306-4fa7-8f5c-5318bbe9f610 of volume 3f70929a-79da-48d9-92ee-ebd30a13f7d6 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:30:22 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb592cc-e7f1-4480-b618-89eec26c3f54]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-8aba5285-4cf6-477b-8a25-ebcd5430b203 req-fcb5cae0-036c-49fe-a60c-e075c0f0e6d7 tempest-AttachVolumeTestJSON-402367968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-040b5282-18c9-4994-bae3-7d877dfd2576', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c16d954-05e7-4a44-8d6e-1ac5e2032086', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:30:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-8aba5285-4cf6-477b-8a25-ebcd5430b203 req-fcb5cae0-036c-49fe-a60c-e075c0f0e6d7 tempest-AttachVolumeTestJSON-402367968 None] attachment_update completed successfully.
Jul 06 15:30:22 devstack sudo[92412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6
Jul 06 15:30:22 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:23 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6" returned: 0 in 0.824s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:23 devstack sudo[92504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 1G
Jul 06 15:30:23 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:24 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 1G" returned: 0 in 0.936s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:24 devstack sudo[92827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610
Jul 06 15:30:24 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:25 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610" returned: 0 in 0.727s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:25 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 is being set with open permissions: ugo+rw
Jul 06 15:30:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:25 devstack sudo[92832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610
Jul 06 15:30:25 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:25 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610" returned: 0 in 0.675s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:25 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.info
Jul 06 15:30:25 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:26 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.info" returned: 0 in 0.733s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:26 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.info is being set with open permissions: ugo+rw
Jul 06 15:30:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:26 devstack sudo[92838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.info
Jul 06 15:30:26 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:27 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.info" returned: 0 in 0.860s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.934s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-cbb657fb-fcdc-48a9-9e6d-9fbcf5aa10f1 tempest-VolumesDeleteCascade-858340595 None] Create snapshot completed successfully
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Flow 'volume_create_manager' (720369cb-2525-4bed-9a2a-7c85c4404650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ae1df6-42fa-40b3-a30d-e5b53444c337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ae1df6-42fa-40b3-a30d-e5b53444c337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-769822159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c594825-bce8-45bd-b1db-efb51937fd42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91c128a3bb63400c83c0b4131946a548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:28Z,use_quota=True,user_id='543ed873f6d440fdbbeb90d1d7376a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44fc82a-413f-4cf0-a1a6-9091bbf260c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44fc82a-413f-4cf0-a1a6-9091bbf260c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab45595-19a1-44a6-8e00-380c559b676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab45595-19a1-44a6-8e00-380c559b676c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c594825-bce8-45bd-b1db-efb51937fd42', 'volume_name': 'volume-8c594825-bce8-45bd-b1db-efb51937fd42', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f21bba-95b9-4845-b22e-adc594cf491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f21bba-95b9-4845-b22e-adc594cf491c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b089875-0ad2-445a-b373-dabebf179b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:28 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Volume 8c594825-bce8-45bd-b1db-efb51937fd42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c594825-bce8-45bd-b1db-efb51937fd42', 'volume_size': 1}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-769822159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c594825-bce8-45bd-b1db-efb51937fd42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91c128a3bb63400c83c0b4131946a548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:28Z,use_quota=True,user_id='543ed873f6d440fdbbeb90d1d7376a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Creating volume 8c594825-bce8-45bd-b1db-efb51937fd42 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:30:28 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:28 devstack sudo[92846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42 1073741824
Jul 06 15:30:28 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:29 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42 1073741824" returned: 0 in 0.997s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:29 devstack sudo[92859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42
Jul 06 15:30:29 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:30 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42" returned: 0 in 0.685s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.430s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b089875-0ad2-445a-b373-dabebf179b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c594825-bce8-45bd-b1db-efb51937fd42', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf55ff7d-5823-4c55-bf6e-1694a3d9552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] Creating offline snapshot 3a61e31d-6c05-4ba5-9b57-23913179913b of volume 3f70929a-79da-48d9-92ee-ebd30a13f7d6 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:30:30 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Volume volume-8c594825-bce8-45bd-b1db-efb51937fd42 (8c594825-bce8-45bd-b1db-efb51937fd42): created successfully
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf55ff7d-5823-4c55-bf6e-1694a3d9552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Flow 'volume_create_manager' (720369cb-2525-4bed-9a2a-7c85c4404650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8514ee13-279a-4eef-b85f-8b7e75a772b1]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:30 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6297ff70-b3dc-47ed-9f9b-02657299b75a tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Created volume successfully.
Jul 06 15:30:30 devstack sudo[92862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610
Jul 06 15:30:30 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:31 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610" returned: 0 in 0.980s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:30:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:31 devstack sudo[92872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b 1G
Jul 06 15:30:31 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:32 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b 1G" returned: 0 in 0.851s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:32 devstack sudo[92877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b
Jul 06 15:30:32 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:32 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b" returned: 0 in 0.816s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:32 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b is being set with open permissions: ugo+rw
Jul 06 15:30:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:32 devstack sudo[92882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b
Jul 06 15:30:32 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:33 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-388dfc03-4074-453c-9fff-06800113ab37 req-f870fb3a-3f40-4731-a0e6-b27c1c7a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b" returned: 0 in 0.856s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.649s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-388dfc03-4074-453c-9fff-06800113ab37 req-f870fb3a-3f40-4731-a0e6-b27c1c7a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.046s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:33 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e5b190-63fb-424b-a596-fbda11e795e8]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-388dfc03-4074-453c-9fff-06800113ab37 req-f870fb3a-3f40-4731-a0e6-b27c1c7a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3e72b8d4-2fca-4645-ac11-15df7662ce52 tempest-VolumesDeleteCascade-858340595 None] Create snapshot completed successfully
Jul 06 15:30:33 devstack sudo[92894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42
Jul 06 15:30:33 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-3f70929a-79da-48d9-92ee-ebd30a13f7d6-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-3f70929a-79da-48d9-92ee-ebd30a13f7d6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Performing cascade delete. {{(pid=86249) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-3a61e31d-6c05-4ba5-9b57-23913179913b-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-3a61e31d-6c05-4ba5-9b57-23913179913b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-3f70929a-79da-48d9-92ee-ebd30a13f7d6" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-3f70929a-79da-48d9-92ee-ebd30a13f7d6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-3a61e31d-6c05-4ba5-9b57-23913179913b" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-3a61e31d-6c05-4ba5-9b57-23913179913b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Deleting offline snapshot 3a61e31d-6c05-4ba5-9b57-23913179913b of volume 3f70929a-79da-48d9-92ee-ebd30a13f7d6 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] snapshot_file for this snap is: volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[276fb976-86f5-4631-8c67-be8847ca29bb]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:34 devstack sudo[92896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b
Jul 06 15:30:34 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:34 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-388dfc03-4074-453c-9fff-06800113ab37 req-f870fb3a-3f40-4731-a0e6-b27c1c7a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42" returned: 0 in 0.917s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-388dfc03-4074-453c-9fff-06800113ab37 req-f870fb3a-3f40-4731-a0e6-b27c1c7a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.941s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-388dfc03-4074-453c-9fff-06800113ab37 req-f870fb3a-3f40-4731-a0e6-b27c1c7a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-8c594825-bce8-45bd-b1db-efb51937fd42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be4e127a-3950-4271-b265-28796bddf1d6', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:30:34 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-388dfc03-4074-453c-9fff-06800113ab37 req-f870fb3a-3f40-4731-a0e6-b27c1c7a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] attachment_update completed successfully.
Jul 06 15:30:35 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b" returned: 0 in 0.828s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:30:35 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8aed5d-429f-4b4c-9207-7671de589cad]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:35 devstack sudo[92905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610
Jul 06 15:30:35 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:35 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610" returned: 0 in 0.776s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:30:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:35 devstack sudo[92912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b
Jul 06 15:30:35 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:37 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b" returned: 0 in 1.212s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:37 devstack sudo[92956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b
Jul 06 15:30:37 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:37 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.3a61e31d-6c05-4ba5-9b57-23913179913b" returned: 0 in 0.634s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-3a61e31d-6c05-4ba5-9b57-23913179913b" released by "_delete_snapshot" :: held 3.545s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-3f70929a-79da-48d9-92ee-ebd30a13f7d6" released by "delete_snapshot" :: held 3.573s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Created reservations ['f2586f63-5fa1-4bac-99a1-629ce93f2d58', '5b04c97b-e823-4993-a8ad-efcd316ecb01', '2e704f0a-db9f-4d54-9b64-cf958cff13a3', 'ddbc1ae7-953b-436a-8348-bc9741fe88ad'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:30:37 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Delete snapshot completed successfully.
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-3a61e31d-6c05-4ba5-9b57-23913179913b-delete_snapshot" released by "delete_snapshot" :: held 3.726s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-78575941-7306-4fa7-8f5c-5318bbe9f610-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-78575941-7306-4fa7-8f5c-5318bbe9f610-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-3f70929a-79da-48d9-92ee-ebd30a13f7d6" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-3f70929a-79da-48d9-92ee-ebd30a13f7d6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-78575941-7306-4fa7-8f5c-5318bbe9f610" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-78575941-7306-4fa7-8f5c-5318bbe9f610" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Deleting offline snapshot 78575941-7306-4fa7-8f5c-5318bbe9f610 of volume 3f70929a-79da-48d9-92ee-ebd30a13f7d6 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] snapshot_file for this snap is: volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ede960-65d6-4a2f-a5fb-4ea3d588b4c1]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:38 devstack sudo[92960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610
Jul 06 15:30:38 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:38 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610" returned: 0 in 0.795s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:30:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5db005-1b9e-4b57-9f12-f188b5f2df17]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:38 devstack sudo[92974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6
Jul 06 15:30:38 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:39 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6" returned: 0 in 1.069s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:39 devstack sudo[93029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610
Jul 06 15:30:39 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:40 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610" returned: 0 in 1.076s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:40 devstack sudo[93056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610
Jul 06 15:30:40 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:41 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6.78575941-7306-4fa7-8f5c-5318bbe9f610" returned: 0 in 0.664s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-78575941-7306-4fa7-8f5c-5318bbe9f610" released by "_delete_snapshot" :: held 3.726s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-3f70929a-79da-48d9-92ee-ebd30a13f7d6" released by "delete_snapshot" :: held 3.749s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:41 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Created reservations ['dd28a353-6a36-4e81-9b07-b69dc52a8bdb', '1ef907b7-f004-473f-a09d-094064833041', 'b0a6c02d-dc30-4d5c-a3b6-79bda1d02bb7', 'e5cd40c0-61b5-4b09-8f83-fb430ccf6e69'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:30:41 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Delete snapshot completed successfully.
Jul 06 15:30:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-78575941-7306-4fa7-8f5c-5318bbe9f610-delete_snapshot" released by "delete_snapshot" :: held 3.945s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Snapshots deleted, issuing volume delete {{(pid=86249) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 06 15:30:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-3f70929a-79da-48d9-92ee-ebd30a13f7d6" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-3f70929a-79da-48d9-92ee-ebd30a13f7d6" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:41 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c173636f-ee71-49f1-bd13-f34c7f8d79b7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:42 devstack sudo[93065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6
Jul 06 15:30:42 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:42 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6" returned: 0 in 0.863s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:42 devstack sudo[93070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6
Jul 06 15:30:42 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-e907373f-102a-4fe8-97aa-df15d30d667a req-ea0d293e-cb26-4b53-bacc-942300b01305 tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Terminate volume connection completed successfully.
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-e907373f-102a-4fe8-97aa-df15d30d667a req-ea0d293e-cb26-4b53-bacc-942300b01305 tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Deleting attachment be4e127a-3950-4271-b265-28796bddf1d6. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:30:43 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3f70929a-79da-48d9-92ee-ebd30a13f7d6" returned: 0 in 0.841s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-3f70929a-79da-48d9-92ee-ebd30a13f7d6" released by "delete_volume" :: held 1.801s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=65,cinder:UPDATE=67,cinder:DELETE=9,cinder:INSERT=16 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=73,cinder:SELECT=67,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Created reservations ['d546ea5e-cd2e-40c3-bdbd-98ce106ad147', '2d19b939-79ce-4548-bf71-a980e6beee3b', '8d5fec8f-b04e-4504-8c9b-67e6c4f43000', 'e1245e80-9b0e-4206-98e7-f9d14820f9d4'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:44 devstack sudo[93111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:30:44 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:44 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.940s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:44 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:30:44 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Deleted volume successfully.
Jul 06 15:30:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de4411ef-d916-4626-b023-ca376521f81d tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-3f70929a-79da-48d9-92ee-ebd30a13f7d6-delete_volume" released by "delete_volume" :: held 10.841s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Flow 'volume_create_manager' (f270f4a8-ef0e-4fe0-be2c-1a09678f560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d04784-4cdb-46ef-a03f-5b23af5eeb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d04784-4cdb-46ef-a03f-5b23af5eeb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-471665642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114076e4-1c2b-46b2-8d1a-1765a59c5426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70ebc598f8242deaa2b9d52ab61072c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:45Z,use_quota=True,user_id='d486a414b3ef4c3eb228a8dd2327b5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2d0f53-fb81-45c3-b611-6331a818910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2d0f53-fb81-45c3-b611-6331a818910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7093d6aa-62ee-4b81-aec4-56ad2b13f6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7093d6aa-62ee-4b81-aec4-56ad2b13f6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114076e4-1c2b-46b2-8d1a-1765a59c5426', 'volume_name': 'volume-114076e4-1c2b-46b2-8d1a-1765a59c5426', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c80bab8-fcc2-4ed0-b008-baf24ed40a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c80bab8-fcc2-4ed0-b008-baf24ed40a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147aa894-eeac-4975-87a3-cd0a96fb793b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:45 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Volume 114076e4-1c2b-46b2-8d1a-1765a59c5426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114076e4-1c2b-46b2-8d1a-1765a59c5426', 'volume_size': 1}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-471665642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114076e4-1c2b-46b2-8d1a-1765a59c5426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70ebc598f8242deaa2b9d52ab61072c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:45Z,use_quota=True,user_id='d486a414b3ef4c3eb228a8dd2327b5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Creating volume 114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:30:45 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:45 devstack sudo[93121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 1073741824
Jul 06 15:30:45 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Acquiring lock "cinder-8c594825-bce8-45bd-b1db-efb51937fd42-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "cinder-8c594825-bce8-45bd-b1db-efb51937fd42-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Acquiring lock "cinder-quobyte-8c594825-bce8-45bd-b1db-efb51937fd42" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "cinder-quobyte-8c594825-bce8-45bd-b1db-efb51937fd42" acquired by "delete_volume" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ad0010-9f63-4182-b7fa-8d0b13a4fedb]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:45 devstack sudo[93123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42
Jul 06 15:30:45 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:46 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 1073741824" returned: 0 in 0.971s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:46 devstack sudo[93129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426
Jul 06 15:30:46 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:46 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42" returned: 0 in 0.970s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:46 devstack sudo[93135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42
Jul 06 15:30:46 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:46 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426" returned: 0 in 0.638s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147aa894-eeac-4975-87a3-cd0a96fb793b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114076e4-1c2b-46b2-8d1a-1765a59c5426', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac38aecc-9ce5-4060-b125-984426ed9650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:46 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Volume volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 (114076e4-1c2b-46b2-8d1a-1765a59c5426): created successfully
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac38aecc-9ce5-4060-b125-984426ed9650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Flow 'volume_create_manager' (f270f4a8-ef0e-4fe0-be2c-1a09678f560e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6cf92fca-a6ba-444a-b609-763ecc008a8a tempest-VolumesDeleteCascade-858340595 None] Created volume successfully.
Jul 06 15:30:47 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8c594825-bce8-45bd-b1db-efb51937fd42" returned: 0 in 0.654s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "cinder-quobyte-8c594825-bce8-45bd-b1db-efb51937fd42" released by "delete_volume" :: held 1.701s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Created reservations ['f71f50a0-7a0b-4b08-8879-18082ddfd3fc', '92984173-c4f0-40a1-8b6d-f5ab46e296d4', '4d04f2db-7903-4be7-9018-853aba014062', '2a1b735f-47e2-4cc8-8822-90aeae80e73f'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:47 devstack sudo[93141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:30:47 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Creating offline snapshot 133c155b-78c9-4af6-a614-35cc9fc14ff1 of volume 114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4aa152-1085-4ade-9c97-2013183f03a6]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:47 devstack sudo[93143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426
Jul 06 15:30:47 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:47 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Flow 'volume_create_manager' (63bb9584-545d-4c18-a3ef-adbd84f03268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549dcb0c-16a6-4cf4-a7f0-c690dc7f03df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549dcb0c-16a6-4cf4-a7f0-c690dc7f03df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-595506041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdca30c-83f1-4f92-b178-d3815a29b9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16644bcf3e8441b48116545e0dd18e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:48Z,use_quota=True,user_id='e1a4444dc1884d259bffdc4f1b3f9025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5217e3d-944f-43be-b593-f048fd214d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5217e3d-944f-43be-b593-f048fd214d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908111ab-82a5-45df-8b20-f93f26879845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908111ab-82a5-45df-8b20-f93f26879845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdca30c-83f1-4f92-b178-d3815a29b9f1', 'volume_name': 'volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446622b0-6738-4d64-afcf-3297fa2c49d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446622b0-6738-4d64-afcf-3297fa2c49d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a945ed81-05bf-47da-84dc-8eddff43b0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:48 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Volume 9fdca30c-83f1-4f92-b178-d3815a29b9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1', 'volume_size': 1}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:48 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.021s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:30:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Deleted volume successfully.
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0016fa05-0e40-4c49-ab0f-6f8566f05d1c tempest-TestServerVolumeAttachScenarioOldVersion-637495343 None] Lock "cinder-8c594825-bce8-45bd-b1db-efb51937fd42-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:30:48 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426" returned: 0 in 1.023s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:48 devstack sudo[93151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 1G
Jul 06 15:30:48 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:49 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 1G" returned: 0 in 0.790s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:49 devstack sudo[93161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1
Jul 06 15:30:49 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:50 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1" returned: 0 in 0.886s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:50 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 is being set with open permissions: ugo+rw
Jul 06 15:30:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:50 devstack sudo[93182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1
Jul 06 15:30:50 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:50 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1" returned: 0 in 0.726s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:50 devstack sudo[93187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.info
Jul 06 15:30:50 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:51 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.info" returned: 0 in 0.793s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:51 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.info is being set with open permissions: ugo+rw
Jul 06 15:30:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:51 devstack sudo[93193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.info
Jul 06 15:30:51 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:52 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.info" returned: 0 in 0.619s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.971s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.215s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-595506041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdca30c-83f1-4f92-b178-d3815a29b9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16644bcf3e8441b48116545e0dd18e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:48Z,use_quota=True,user_id='e1a4444dc1884d259bffdc4f1b3f9025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Creating volume 9fdca30c-83f1-4f92-b178-d3815a29b9f1 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:30:52 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:30:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:52 devstack sudo[93196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1 1073741824
Jul 06 15:30:52 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:52 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e8a3de94-0e51-4ad5-88a2-1c0a035f262e tempest-VolumesDeleteCascade-858340595 None] Create snapshot completed successfully
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:30:53 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1 1073741824" returned: 0 in 1.000s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Flow 'volume_create_manager' (504400b9-cb09-4131-8a5a-6e40fcdaddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec92a887-d619-4357-a353-2dd8ebfc1498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec92a887-d619-4357-a353-2dd8ebfc1498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1764004803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70ebc598f8242deaa2b9d52ab61072c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=133c155b-78c9-4af6-a614-35cc9fc14ff1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:53Z,use_quota=True,user_id='d486a414b3ef4c3eb228a8dd2327b5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6d9577-784f-4361-8a30-199468172b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6d9577-784f-4361-8a30-199468172b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fbb80d-1dab-49a7-adc2-35a3a6b038b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fbb80d-1dab-49a7-adc2-35a3a6b038b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4cb4e58-5cd9-423a-8e46-8bc31b3fc40a', 'volume_name': 'volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a', 'volume_size': 1, 'snapshot_id': '133c155b-78c9-4af6-a614-35cc9fc14ff1'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa317ac-f65f-4b92-bb2f-bea5378a3eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa317ac-f65f-4b92-bb2f-bea5378a3eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db52a2ec-7fec-4971-b5f0-cd96ef73d548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:53 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Volume d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a', 'volume_size': 1, 'snapshot_id': '133c155b-78c9-4af6-a614-35cc9fc14ff1'}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:53 devstack sudo[93209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1
Jul 06 15:30:53 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:54 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1" returned: 0 in 0.663s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.671s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-133c155b-78c9-4af6-a614-35cc9fc14ff1-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" by "_create_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a945ed81-05bf-47da-84dc-8eddff43b0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c87d32-e33d-4a8c-b946-486d9b13e9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-133c155b-78c9-4af6-a614-35cc9fc14ff1-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Creating volume d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a from snapshot 133c155b-78c9-4af6-a614-35cc9fc14ff1 {{(pid=86249) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] snapshot: 133c155b-78c9-4af6-a614-35cc9fc14ff1, volume: d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:30:54 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Volume volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1 (9fdca30c-83f1-4f92-b178-d3815a29b9f1): created successfully
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c87d32-e33d-4a8c-b946-486d9b13e9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Flow 'volume_create_manager' (63bb9584-545d-4c18-a3ef-adbd84f03268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:30:54 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2d4fcdf0-fae1-41e0-9fd0-44456e4d4312 tempest-AttachVolumeShelveTestJSON-1836271176 None] Created volume successfully.
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b369c605-30ff-46cc-9ea6-46dfff1ef74e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:54 devstack sudo[93212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1
Jul 06 15:30:54 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:55 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1" returned: 0 in 0.829s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-114076e4-1c2b-46b2-8d1a-1765a59c5426(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:30:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:30:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:30:55 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[146b7879-76d3-46f6-9756-41327a02b987]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:30:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:55 devstack sudo[93217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426
Jul 06 15:30:55 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:30:56 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root
Jul 06 15:30:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426" returned: 0 in 0.946s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:30:56 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:30:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:30:56 devstack sudo[93226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a
Jul 06 15:30:56 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:01 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" returned: 0 in 5.468s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:01 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58558af-5203-4dfb-8417-eb8bd33921f1]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:01 devstack sudo[93256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426
Jul 06 15:31:01 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:03 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426" returned: 0 in 1.694s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:03 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:31:03 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Converted 1024.00 MB image at 187.23 MB/s
Jul 06 15:31:03 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a is being set with open permissions: ugo+rw
Jul 06 15:31:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:03 devstack sudo[93298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a
Jul 06 15:31:03 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:04 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" returned: 0 in 0.805s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" released by "_copy_volume_from_snapshot" :: held 9.891s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-133c155b-78c9-4af6-a614-35cc9fc14ff1-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" released by "_create_volume_from_snapshot" :: held 9.921s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.954s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db52a2ec-7fec-4971-b5f0-cd96ef73d548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a', 'volume_size': 1, 'snapshot_id': '133c155b-78c9-4af6-a614-35cc9fc14ff1'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decf3e95-b99f-4b52-9bea-3e4923fd6b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:04 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Volume volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a (d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a): created successfully
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decf3e95-b99f-4b52-9bea-3e4923fd6b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Flow 'volume_create_manager' (504400b9-cb09-4131-8a5a-6e40fcdaddc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:31:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-76c479b6-768f-4aec-9617-f7c1f812b1d6 tempest-VolumesDeleteCascade-858340595 None] Created volume successfully.
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-114076e4-1c2b-46b2-8d1a-1765a59c5426-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-114076e4-1c2b-46b2-8d1a-1765a59c5426-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Performing cascade delete. {{(pid=86249) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-133c155b-78c9-4af6-a614-35cc9fc14ff1-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-133c155b-78c9-4af6-a614-35cc9fc14ff1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-114076e4-1c2b-46b2-8d1a-1765a59c5426" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-114076e4-1c2b-46b2-8d1a-1765a59c5426" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-133c155b-78c9-4af6-a614-35cc9fc14ff1" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-133c155b-78c9-4af6-a614-35cc9fc14ff1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Deleting offline snapshot 133c155b-78c9-4af6-a614-35cc9fc14ff1 of volume 114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] snapshot_file for this snap is: volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2118ef-6935-43c0-986a-bb35db826e09]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:04 devstack sudo[93305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1
Jul 06 15:31:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-aa2aa834-a3e5-4755-8399-b9d8522a8f98 req-22a54ca9-1986-4bd3-979e-5adbf1bac811 tempest-AttachVolumeTestJSON-402367968 None] Terminate volume connection completed successfully.
Jul 06 15:31:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-aa2aa834-a3e5-4755-8399-b9d8522a8f98 req-22a54ca9-1986-4bd3-979e-5adbf1bac811 tempest-AttachVolumeTestJSON-402367968 None] Deleting attachment 7c16d954-05e7-4a44-8d6e-1ac5e2032086. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:31:04 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:05 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1" returned: 0 in 0.979s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-114076e4-1c2b-46b2-8d1a-1765a59c5426(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:31:05 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[55440745-b0d5-4d5c-98a1-c784f41957f8]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:05 devstack sudo[93314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426
Jul 06 15:31:05 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:31:06 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426" returned: 0 in 0.878s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:06 devstack sudo[93322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1
Jul 06 15:31:06 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:06 devstack sudo[93320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:31:06 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:07 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.990s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:31:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:31:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 8 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:31:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:31:07 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1" returned: 0 in 1.156s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:07 devstack sudo[93335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1
Jul 06 15:31:07 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:08 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426.133c155b-78c9-4af6-a614-35cc9fc14ff1" returned: 0 in 0.837s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-133c155b-78c9-4af6-a614-35cc9fc14ff1" released by "_delete_snapshot" :: held 3.998s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-114076e4-1c2b-46b2-8d1a-1765a59c5426" released by "delete_snapshot" :: held 4.025s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:08 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Created reservations ['d4dc5de3-7daa-468f-8d3f-143454711a9a', 'd68b510a-17c9-4235-af66-c3050f101d3c', 'aa1a891b-cc55-4ac3-83ee-320c00c23dde', 'ab97ca44-d68d-4e79-b56f-51965eb9b4d7'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:31:08 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Delete snapshot completed successfully.
Jul 06 15:31:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-133c155b-78c9-4af6-a614-35cc9fc14ff1-delete_snapshot" released by "delete_snapshot" :: held 4.226s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Snapshots deleted, issuing volume delete {{(pid=86249) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 06 15:31:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-114076e4-1c2b-46b2-8d1a-1765a59c5426" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-114076e4-1c2b-46b2-8d1a-1765a59c5426" acquired by "delete_volume" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ebc9d-258a-43f1-9a5f-06d5cf8df149]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:09 devstack sudo[93338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426
Jul 06 15:31:09 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:10 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426" returned: 0 in 1.100s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:10 devstack sudo[93351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426
Jul 06 15:31:10 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:10 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-114076e4-1c2b-46b2-8d1a-1765a59c5426" returned: 0 in 0.768s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:10 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-114076e4-1c2b-46b2-8d1a-1765a59c5426" released by "delete_volume" :: held 1.987s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:10 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Created reservations ['46caca91-6a66-495e-beca-9754cfb5c7b5', '87fb6f7e-0594-4491-ac87-3f546e030e69', '5dbfd275-f2cc-491e-8ef1-31427fafc3f8', 'fc1b48b3-2c48-4937-adf8-88f20f205977'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:11 devstack sudo[93369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:31:11 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "cinder-quobyte-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" acquired by "delete_volume" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[733af459-6a7c-4c7b-a9aa-8441f73ba2c3]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:11 devstack sudo[93371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a
Jul 06 15:31:11 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:12 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.067s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:12 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:31:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Deleted volume successfully.
Jul 06 15:31:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8f87e3d4-2b77-4652-9d30-67bbdd739aa5 tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-114076e4-1c2b-46b2-8d1a-1765a59c5426-delete_volume" released by "delete_volume" :: held 7.638s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-5b79f335-50c4-4975-b268-ba9fcd062a2c req-a903e3f6-fa70-4781-bfda-29c7e88ab87e tempest-AttachVolumeShelveTestJSON-1836271176 None] No connector for attachment 451afa3d-7cf6-423d-99d0-b021c18d6a84; skipping storage backend terminate_connection call. {{(pid=86249) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 06 15:31:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-5b79f335-50c4-4975-b268-ba9fcd062a2c req-a903e3f6-fa70-4781-bfda-29c7e88ab87e tempest-AttachVolumeShelveTestJSON-1836271176 None] Deleting attachment 451afa3d-7cf6-423d-99d0-b021c18d6a84. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:31:12 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" returned: 0 in 1.158s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:12 devstack sudo[93377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a
Jul 06 15:31:12 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:13 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" returned: 0 in 0.905s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-quobyte-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a" released by "delete_volume" :: held 2.142s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:13 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Created reservations ['f05925a3-5128-4f0b-93ad-ab22cb67a99f', 'a5097c57-da7c-4191-95a6-5b6e1e6791b5', 'e394241c-6c38-4cf2-81c3-906f2a1e6c22', '029af03b-0911-4320-b309-d21d9b99187a'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:31:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:14 devstack sudo[93382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:31:14 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:14 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.682s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:14 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:31:14 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Deleted volume successfully.
Jul 06 15:31:14 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c3f16954-4d45-4fb4-84c2-07111ab8d9dc tempest-VolumesDeleteCascade-858340595 None] Lock "cinder-d4cb4e58-5cd9-423a-8e46-8bc31b3fc40a-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Flow 'volume_create_manager' (f8cc6a07-1b28-454d-81f2-5bf9214a098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d161fa25-ff88-4b6c-937d-e9316a70bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d161fa25-ff88-4b6c-937d-e9316a70bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-279813441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4554b3-3554-4818-9ed2-1b20eade7ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2e405e3664fe8acdf6beb6d0098a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:19Z,use_quota=True,user_id='04f3be70115e43748d5874da47f707e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b00fe1-7df1-4e55-b1ca-ae36df05c561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b00fe1-7df1-4e55-b1ca-ae36df05c561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88a6820-c0d5-4edd-9f26-cbde5e7f8608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88a6820-c0d5-4edd-9f26-cbde5e7f8608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e4554b3-3554-4818-9ed2-1b20eade7ea6', 'volume_name': 'volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012a4cac-ce67-424f-a540-824abeb43e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012a4cac-ce67-424f-a540-824abeb43e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a085bf3-584f-4c9a-b97d-9bca992139a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:18 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Volume 1e4554b3-3554-4818-9ed2-1b20eade7ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6', 'volume_size': 1}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-279813441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4554b3-3554-4818-9ed2-1b20eade7ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2e405e3664fe8acdf6beb6d0098a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:19Z,use_quota=True,user_id='04f3be70115e43748d5874da47f707e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Creating volume 1e4554b3-3554-4818-9ed2-1b20eade7ea6 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:31:18 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:31:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:19 devstack sudo[93479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6 1073741824
Jul 06 15:31:19 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:20 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6 1073741824" returned: 0 in 1.776s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:20 devstack sudo[93493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6
Jul 06 15:31:20 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:21 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6" returned: 0 in 0.982s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] <== create_volume: return (2834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:31:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.836s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a085bf3-584f-4c9a-b97d-9bca992139a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538500aa-255b-42f1-b1cb-848d1a9686c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:21 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Volume volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6 (1e4554b3-3554-4818-9ed2-1b20eade7ea6): created successfully
Jul 06 15:31:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538500aa-255b-42f1-b1cb-848d1a9686c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Flow 'volume_create_manager' (f8cc6a07-1b28-454d-81f2-5bf9214a098f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:31:21 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-067273bc-2adb-42dc-a8f9-3b6633b56ea6 tempest-VolumesMetadataTest-1612174547 None] Created volume successfully.
Jul 06 15:31:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Acquiring lock "cinder-1e4554b3-3554-4818-9ed2-1b20eade7ea6-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Lock "cinder-1e4554b3-3554-4818-9ed2-1b20eade7ea6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Acquiring lock "cinder-quobyte-1e4554b3-3554-4818-9ed2-1b20eade7ea6" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Lock "cinder-quobyte-1e4554b3-3554-4818-9ed2-1b20eade7ea6" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69e7e4d-c568-4740-ab96-d46203cd57fa]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:23 devstack sudo[93502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6
Jul 06 15:31:23 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:25 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6" returned: 0 in 1.519s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:25 devstack sudo[93508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6
Jul 06 15:31:25 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:26 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1e4554b3-3554-4818-9ed2-1b20eade7ea6" returned: 0 in 1.155s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Lock "cinder-quobyte-1e4554b3-3554-4818-9ed2-1b20eade7ea6" released by "delete_volume" :: held 2.740s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:26 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Created reservations ['a984600a-beef-4ed2-8707-48f928d0c9c4', '662a3329-c2d7-4e62-acf1-c476ac6066c6', '6de01f7f-4fa4-4f36-b259-a25b3ab7cbe1', '6b14ec6a-2afe-47e6-bb1d-10c70c2f627c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:31:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:26 devstack sudo[93511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:31:26 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:27 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.782s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:27 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:31:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Deleted volume successfully.
Jul 06 15:31:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-919d1d95-008f-4c12-82bf-e7226798ffb6 tempest-VolumesMetadataTest-1612174547 None] Lock "cinder-1e4554b3-3554-4818-9ed2-1b20eade7ea6-delete_volume" released by "delete_volume" :: held 3.882s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Flow 'volume_create_manager' (edace62a-f108-42f1-bf3a-ef6f19525ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5a744c-c6d8-4dd2-b90e-915cbfd7c256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5a744c-c6d8-4dd2-b90e-915cbfd7c256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1469849284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cfdd68-62f3-43df-ae95-7fb65b89e777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac08fdcbea1402482b0e12ef79d2b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:34Z,use_quota=True,user_id='bffa21c20fb64ad0891f7022de228035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4b8339-2be5-4a29-b553-2e6fbf86f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4b8339-2be5-4a29-b553-2e6fbf86f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736b476c-953d-45a7-9bda-2a13b2df9406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736b476c-953d-45a7-9bda-2a13b2df9406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4cfdd68-62f3-43df-ae95-7fb65b89e777', 'volume_name': 'volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28f2861-f859-4700-8c74-98e454a97690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28f2861-f859-4700-8c74-98e454a97690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6578a7-1374-43b1-8478-dee2fe88a3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:34 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Volume a4cfdd68-62f3-43df-ae95-7fb65b89e777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777', 'volume_size': 1}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1469849284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cfdd68-62f3-43df-ae95-7fb65b89e777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac08fdcbea1402482b0e12ef79d2b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:34Z,use_quota=True,user_id='bffa21c20fb64ad0891f7022de228035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Creating volume a4cfdd68-62f3-43df-ae95-7fb65b89e777 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:31:34 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:31:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:34 devstack sudo[93551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777 1073741824
Jul 06 15:31:34 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:35 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777 1073741824" returned: 0 in 1.362s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:35 devstack sudo[93598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777
Jul 06 15:31:35 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:36 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777" returned: 0 in 0.738s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:31:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.173s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6578a7-1374-43b1-8478-dee2fe88a3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee5aeb5-145f-4a5b-8c69-0855d9e7ccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:36 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Volume volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777 (a4cfdd68-62f3-43df-ae95-7fb65b89e777): created successfully
Jul 06 15:31:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee5aeb5-145f-4a5b-8c69-0855d9e7ccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Flow 'volume_create_manager' (edace62a-f108-42f1-bf3a-ef6f19525ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:31:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-32093d8a-a91a-4c4f-ace4-bf9b400cac38 tempest-VolumesTransfersTest-1503729975 None] Created volume successfully.
Jul 06 15:31:39 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-49301dda-1db0-4a91-978d-a777a2d648b6 tempest-VolumesTransfersTest-1452228179 None] Transfer volume completed successfully.
Jul 06 15:31:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Acquiring lock "cinder-a4cfdd68-62f3-43df-ae95-7fb65b89e777-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Lock "cinder-a4cfdd68-62f3-43df-ae95-7fb65b89e777-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Acquiring lock "cinder-quobyte-a4cfdd68-62f3-43df-ae95-7fb65b89e777" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Lock "cinder-quobyte-a4cfdd68-62f3-43df-ae95-7fb65b89e777" acquired by "delete_volume" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:41 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96c2974-ab2e-4aaa-8252-e4e4f065533e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:41 devstack sudo[93648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777
Jul 06 15:31:41 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:42 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777" returned: 0 in 1.098s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:42 devstack sudo[93653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777
Jul 06 15:31:42 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:43 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a4cfdd68-62f3-43df-ae95-7fb65b89e777" returned: 0 in 0.823s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Lock "cinder-quobyte-a4cfdd68-62f3-43df-ae95-7fb65b89e777" released by "delete_volume" :: held 1.998s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:43 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Created reservations ['4f35157d-3ccd-4c19-a958-59ab27c00bae', '0079f173-1527-4c99-bbd9-ea1477d994c9', 'b51ebf11-5774-4727-a39e-5437f5b739d9', '2e8b75ae-307f-4569-ae91-bdfb1ce08650'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:31:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:43 devstack sudo[93656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:31:43 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:INSERT=16,cinder:UPDATE=60,cinder:SELECT=53,cinder:DELETE=7 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=79,cinder:SELECT=46,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Flow 'volume_create_manager' (9ad5fcb5-bf9c-4a36-b91a-150f60e7d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca3ebf9-d810-4dfe-8a85-4bcbcba36b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca3ebf9-d810-4dfe-8a85-4bcbcba36b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1495006861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea269b9-3b82-445b-bb4d-6f467e9931b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac08fdcbea1402482b0e12ef79d2b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:44Z,use_quota=True,user_id='bffa21c20fb64ad0891f7022de228035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d5ce82-f0f2-4bdd-a0d4-76b51788dc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d5ce82-f0f2-4bdd-a0d4-76b51788dc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800694ae-8b65-47a5-9206-042d56ba5f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800694ae-8b65-47a5-9206-042d56ba5f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea269b9-3b82-445b-bb4d-6f467e9931b1', 'volume_name': 'volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f9aff1-f6d2-480a-9610-370efcbe727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f9aff1-f6d2-480a-9610-370efcbe727d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36a23b7-5f86-443b-9f99-8cd15a663940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:44 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Volume 9ea269b9-3b82-445b-bb4d-6f467e9931b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1', 'volume_size': 1}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1495006861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea269b9-3b82-445b-bb4d-6f467e9931b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac08fdcbea1402482b0e12ef79d2b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:44Z,use_quota=True,user_id='bffa21c20fb64ad0891f7022de228035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Creating volume 9ea269b9-3b82-445b-bb4d-6f467e9931b1 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:31:44 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:44 devstack sudo[93661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1 1073741824
Jul 06 15:31:44 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:44 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.247s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:31:44 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Deleted volume successfully.
Jul 06 15:31:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cd4633bb-faf8-4e86-8958-17fe297248f9 tempest-VolumesTransfersTest-1607883746 None] Lock "cinder-a4cfdd68-62f3-43df-ae95-7fb65b89e777-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:45 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:31:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Flow 'volume_create_manager' (2927facd-1bc0-4f05-aebb-4ebcf15363a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:31:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f428cd22-afd3-43b6-98fc-003bbc531ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f428cd22-afd3-43b6-98fc-003bbc531ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-564513531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919a4753-70be-471a-8bed-f5019004c1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca40202015fd4fe6bff90a7f30e0fbe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:46Z,use_quota=True,user_id='c782aa76609649ac803307766b32c816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:45 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5c6503-2cbc-4496-895f-73418d6eb08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5c6503-2cbc-4496-895f-73418d6eb08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff2581f-30a0-4ad3-b1d6-18097123c756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:45 devstack cinder-volume[86249]: DEBUG cinder.image.glance [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Creating Keystone auth plugin from conf {{(pid=86249) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 15:31:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1 1073741824" returned: 0 in 1.488s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:45 devstack sudo[93668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1
Jul 06 15:31:45 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff2581f-30a0-4ad3-b1d6-18097123c756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '919a4753-70be-471a-8bed-f5019004c1fe', 'volume_name': 'volume-919a4753-70be-471a-8bed-f5019004c1fe', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8f6b200>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9678a1c3-9967-4953-a88d-32ff49ca2d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9678a1c3-9967-4953-a88d-32ff49ca2d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8390b710-9790-4a65-ae3f-055e21129a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:46 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Volume 919a4753-70be-471a-8bed-f5019004c1fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-919a4753-70be-471a-8bed-f5019004c1fe', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8f6b200>}
Jul 06 15:31:46 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Trying to clone 919a4753-70be-471a-8bed-f5019004c1fe from image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]). {{(pid=86249) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 15:31:47 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1" returned: 0 in 1.264s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] <== create_volume: return (2820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:31:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.823s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36a23b7-5f86-443b-9f99-8cd15a663940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf525e4-7fc0-460f-ac93-b7bc176fc154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:47 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Volume volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1 (9ea269b9-3b82-445b-bb4d-6f467e9931b1): created successfully
Jul 06 15:31:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf525e4-7fc0-460f-ac93-b7bc176fc154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Flow 'volume_create_manager' (9ad5fcb5-bf9c-4a36-b91a-150f60e7d08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:31:47 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e49db412-de80-4245-8d5a-960b776dfe4f tempest-VolumesTransfersTest-1503729975 None] Created volume successfully.
Jul 06 15:31:47 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 15:31:47 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 15:31:47 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4531d693-1c8b-4166-9a55-919dcd7bcdd5]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:48 devstack sudo[93714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD
Jul 06 15:31:48 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:49 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD" returned: 0 in 1.182s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:49 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Temporary image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 is fetched for user c782aa76609649ac803307766b32c816. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 15:31:49 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b484d9c-b42b-4765-8c99-87cf8adad81b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Acquiring lock "cinder-9ea269b9-3b82-445b-bb4d-6f467e9931b1-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Lock "cinder-9ea269b9-3b82-445b-bb4d-6f467e9931b1-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Acquiring lock "cinder-quobyte-9ea269b9-3b82-445b-bb4d-6f467e9931b1" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:31:49 devstack sudo[93722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD
Jul 06 15:31:49 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Lock "cinder-quobyte-9ea269b9-3b82-445b-bb4d-6f467e9931b1" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:31:49 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b438fb11-511c-4950-82e7-442100964f5c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:49 devstack sudo[93726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1
Jul 06 15:31:49 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:50 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD" returned: 0 in 0.870s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-564513531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919a4753-70be-471a-8bed-f5019004c1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca40202015fd4fe6bff90a7f30e0fbe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:46Z,use_quota=True,user_id='c782aa76609649ac803307766b32c816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Creating volume 919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:31:50 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:50 devstack sudo[93732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe 1073741824
Jul 06 15:31:50 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:50 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1" returned: 0 in 0.940s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:50 devstack sudo[93737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1
Jul 06 15:31:50 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:51 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe 1073741824" returned: 0 in 0.892s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:51 devstack sudo[93743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:31:51 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:51 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9ea269b9-3b82-445b-bb4d-6f467e9931b1" returned: 0 in 0.773s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Lock "cinder-quobyte-9ea269b9-3b82-445b-bb4d-6f467e9931b1" released by "delete_volume" :: held 1.762s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Created reservations ['337d7b17-2eb5-483d-9407-8a7013c8d2c3', '6a07de63-4627-4625-ba17-ea25a9cbb348', '3702d4f6-f50e-4c05-960f-ca48c8470b36', 'ef0d7a6a-5265-4553-ae28-cd43e249707a'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:51 devstack sudo[93745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:31:51 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:51 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 0 in 0.668s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Attempting download of af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 ((None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}])) to volume 919a4753-70be-471a-8bed-f5019004c1fe. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea3d5c8-aa48-4e1a-b042-632ba5ca7a85]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_7rmudoe2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:52 devstack sudo[93748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_7rmudoe2
Jul 06 15:31:52 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:52 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.671s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:52 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:31:52 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Deleted volume successfully.
Jul 06 15:31:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-35e81ac4-7eb3-472c-b068-5af3b57a1935 tempest-VolumesTransfersTest-1607883746 None] Lock "cinder-9ea269b9-3b82-445b-bb4d-6f467e9931b1-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:31:52 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_7rmudoe2" returned: 0 in 0.769s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_7rmudoe2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:52 devstack sudo[93753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_7rmudoe2
Jul 06 15:31:52 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:53 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_7rmudoe2" returned: 1 in 0.809s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_7rmudoe2' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:31:53 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79d10b7-f8b7-447c-80b2-c8d320213333]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:53 devstack sudo[93758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD
Jul 06 15:31:53 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:54 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:54 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 was qcow2, converting to raw {{(pid=86249) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 15:31:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:54 devstack sudo[93764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:31:54 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:56 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 0 in 2.370s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:56 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_xaak2o1idevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:31:56 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Converted 112.00 MB image at 47.24 MB/s
Jul 06 15:31:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:56 devstack sudo[93772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe 1G
Jul 06 15:31:56 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:57 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe 1G" returned: 0 in 0.833s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:57 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a138dc3e-ffcf-4707-91c9-e23bc64e8362]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:31:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:57 devstack sudo[93778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:31:57 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Flow 'volume_create_manager' (5e41658a-3d4d-40d0-8061-edaa1fb8eaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f4647a-f82b-4294-88a7-a9bb324f7d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f4647a-f82b-4294-88a7-a9bb324f7d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-865807224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b1d772-6f00-482f-9a90-61cc4203beb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0512b652baee4a8fb96df880ee30049d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:58Z,use_quota=True,user_id='c04bf95f24c646d49e505bd5d983199e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb400ba-067c-43d2-85d2-fb9b63d90b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb400ba-067c-43d2-85d2-fb9b63d90b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc23ea19-8c91-464a-9c3c-134c2224a30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc23ea19-8c91-464a-9c3c-134c2224a30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b1d772-6f00-482f-9a90-61cc4203beb3', 'volume_name': 'volume-94b1d772-6f00-482f-9a90-61cc4203beb3', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fa890d-c225-40b2-9bda-ee0714a75b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fa890d-c225-40b2-9bda-ee0714a75b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3130cc9c-d588-45be-8b1f-acfd71ed436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:58 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Volume 94b1d772-6f00-482f-9a90-61cc4203beb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b1d772-6f00-482f-9a90-61cc4203beb3', 'volume_size': 1}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-865807224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b1d772-6f00-482f-9a90-61cc4203beb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0512b652baee4a8fb96df880ee30049d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:58Z,use_quota=True,user_id='c04bf95f24c646d49e505bd5d983199e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Creating volume 94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:31:58 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:58 devstack sudo[93783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 1073741824
Jul 06 15:31:58 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:58 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 0 in 0.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:58 devstack sudo[93787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:31:58 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:59 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 1073741824" returned: 0 in 0.977s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:31:59 devstack sudo[93797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3
Jul 06 15:31:59 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:31:59 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 1 in 0.861s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Downloaded image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 ((None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}])) to volume 919a4753-70be-471a-8bed-f5019004c1fe successfully. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Temporary image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 for user c782aa76609649ac803307766b32c816 is deleted. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Marking volume 919a4753-70be-471a-8bed-f5019004c1fe as bootable. {{(pid=86249) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Copying metadata from image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 to 919a4753-70be-471a-8bed-f5019004c1fe. {{(pid=86249) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Creating volume glance metadata for volume 919a4753-70be-471a-8bed-f5019004c1fe backed by image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86249) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8390b710-9790-4a65-ae3f-055e21129a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-919a4753-70be-471a-8bed-f5019004c1fe', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8f6b200>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ae30de-f46f-4f4d-bac9-a007ee63e1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:59 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Volume volume-919a4753-70be-471a-8bed-f5019004c1fe (919a4753-70be-471a-8bed-f5019004c1fe): created successfully
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ae30de-f46f-4f4d-bac9-a007ee63e1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Flow 'volume_create_manager' (2927facd-1bc0-4f05-aebb-4ebcf15363a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:31:59 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-22687185-687e-4bab-90dd-f8086f3e4b5e tempest-TestShelveInstance-150764035 None] Created volume successfully.
Jul 06 15:31:59 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3" returned: 0 in 0.720s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3130cc9c-d588-45be-8b1f-acfd71ed436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b1d772-6f00-482f-9a90-61cc4203beb3', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:31:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4041ad-f3b4-4ab8-b5b6-584486427a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:31:59 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Volume volume-94b1d772-6f00-482f-9a90-61cc4203beb3 (94b1d772-6f00-482f-9a90-61cc4203beb3): created successfully
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4041ad-f3b4-4ab8-b5b6-584486427a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Flow 'volume_create_manager' (5e41658a-3d4d-40d0-8061-edaa1fb8eaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:32:00 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e4407c88-b151-4a53-9589-d4d4c35ff04e tempest-VolumesCloneTest-431580592 None] Created volume successfully.
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Flow 'volume_create_manager' (0c49682f-34f4-4886-bda9-eba8e684f9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd784f8-0a2a-4929-8056-a1718cffaaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd784f8-0a2a-4929-8056-a1718cffaaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1130353600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474464e7-f088-4b70-ae99-0045f6227dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0512b652baee4a8fb96df880ee30049d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=94b1d772-6f00-482f-9a90-61cc4203beb3,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:01Z,use_quota=True,user_id='c04bf95f24c646d49e505bd5d983199e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a372dd3b-afc1-45ac-b238-feb6f1cb7802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a372dd3b-afc1-45ac-b238-feb6f1cb7802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862f229d-1445-4ef7-a5a2-3ad4bbf735be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862f229d-1445-4ef7-a5a2-3ad4bbf735be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '474464e7-f088-4b70-ae99-0045f6227dce', 'volume_name': 'volume-474464e7-f088-4b70-ae99-0045f6227dce', 'volume_size': 2, 'source_volid': '94b1d772-6f00-482f-9a90-61cc4203beb3', 'source_volstatus': 'available'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe98bf6-dc69-42e0-bf83-858c15462259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe98bf6-dc69-42e0-bf83-858c15462259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad014dd-d1e8-4c9d-9e39-019c4b069098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:00 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Volume 474464e7-f088-4b70-ae99-0045f6227dce: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-474464e7-f088-4b70-ae99-0045f6227dce', 'volume_size': 2, 'source_volid': '94b1d772-6f00-482f-9a90-61cc4203beb3', 'source_volstatus': 'available'}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:00 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Cloning volume 94b1d772-6f00-482f-9a90-61cc4203beb3 to volume 474464e7-f088-4b70-ae99-0045f6227dce
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Creating offline snapshot 4c766ee5-ab40-44b8-afa5-2fe06112825f of volume 94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8755c0e-0090-4f33-bea2-24c03df2b7a1]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:01 devstack sudo[93807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3
Jul 06 15:32:01 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:01 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3" returned: 0 in 0.838s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:01 devstack sudo[93814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f 1G
Jul 06 15:32:01 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:02 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f 1G" returned: 0 in 1.078s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94b1d772-6f00-482f-9a90-61cc4203beb3 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:02 devstack sudo[93840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94b1d772-6f00-482f-9a90-61cc4203beb3 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f
Jul 06 15:32:02 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:03 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94b1d772-6f00-482f-9a90-61cc4203beb3 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f" returned: 0 in 0.859s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:03 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f is being set with open permissions: ugo+rw
Jul 06 15:32:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:03 devstack sudo[93859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f
Jul 06 15:32:03 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:04 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f" returned: 0 in 1.185s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:05 devstack sudo[93897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.info
Jul 06 15:32:05 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:05 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.info" returned: 0 in 0.736s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:05 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.info is being set with open permissions: ugo+rw
Jul 06 15:32:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:05 devstack sudo[93907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.info
Jul 06 15:32:05 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:06 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.info" returned: 0 in 0.708s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Acquiring lock "cinder-quobyte-474464e7-f088-4b70-ae99-0045f6227dce" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Lock "cinder-quobyte-474464e7-f088-4b70-ae99-0045f6227dce" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] snapshot: 4c766ee5-ab40-44b8-afa5-2fe06112825f, volume: 474464e7-f088-4b70-ae99-0045f6227dce,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baeb2bb-4cb5-43b3-87b4-e444fa8e18ac]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:06 devstack sudo[93911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:32:06 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:06 devstack sudo[93910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f
Jul 06 15:32:06 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-df166f3c-9049-46a5-8c1a-087f46c31b46 req-f2ae9ff0-937a-49a0-84fe-b5a8abcdbbf5 tempest-TestShelveInstance-150764035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:07 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.999s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:32:07 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f" returned: 0 in 1.083s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94b1d772-6f00-482f-9a90-61cc4203beb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[436ef69c-a113-42b4-b395-1391d40b612d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:07 devstack sudo[93927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3
Jul 06 15:32:07 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3" returned: 0 in 1.082s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:08 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:32:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:08 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:08 devstack sudo[93946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce
Jul 06 15:32:08 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Acquiring lock "cinder-9fdca30c-83f1-4f92-b178-d3815a29b9f1-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:32:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Lock "cinder-9fdca30c-83f1-4f92-b178-d3815a29b9f1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:32:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Acquiring lock "cinder-quobyte-9fdca30c-83f1-4f92-b178-d3815a29b9f1" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:32:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Lock "cinder-quobyte-9fdca30c-83f1-4f92-b178-d3815a29b9f1" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:32:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ec2ec9-5ca5-43f9-97b4-b803d3593519]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:09 devstack sudo[93986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1
Jul 06 15:32:09 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:11 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1" returned: 0 in 1.670s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:11 devstack sudo[94021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1
Jul 06 15:32:11 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:12 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9fdca30c-83f1-4f92-b178-d3815a29b9f1" returned: 0 in 1.367s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Lock "cinder-quobyte-9fdca30c-83f1-4f92-b178-d3815a29b9f1" released by "delete_volume" :: held 3.103s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:32:12 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Created reservations ['a138e10b-e4fd-4346-a793-0919c0ddfae9', 'f22a9675-5713-42d1-924d-28f7267a1ad5', '312039d0-1fe6-4a66-a36a-dc5a7c934d3a', '284dd913-89e9-46de-91c1-6c411dc50b8d'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:32:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:32:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:32:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:13 devstack sudo[94027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:32:13 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:15 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 2.473s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:15 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:32:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Deleted volume successfully.
Jul 06 15:32:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4d0455e4-5c89-46ce-9983-0de5fa76c731 tempest-AttachVolumeShelveTestJSON-1836271176 None] Lock "cinder-9fdca30c-83f1-4f92-b178-d3815a29b9f1-delete_volume" released by "delete_volume" :: held 6.267s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:32:16 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce" returned: 0 in 7.608s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:16 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce52696b-9622-4823-99bf-b0ac0c3ee729]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:16 devstack sudo[94032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3
Jul 06 15:32:16 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:17 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3" returned: 0 in 1.389s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:17 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:32:17 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Converted 1024.00 MB image at 134.57 MB/s
Jul 06 15:32:17 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce is being set with open permissions: ugo+rw
Jul 06 15:32:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:17 devstack sudo[94039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce
Jul 06 15:32:17 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:18 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce" returned: 0 in 0.765s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Lock "cinder-quobyte-474464e7-f088-4b70-ae99-0045f6227dce" released by "_copy_volume_from_snapshot" :: held 12.059s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:32:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Acquiring lock "cinder-quobyte-4c766ee5-ab40-44b8-afa5-2fe06112825f" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:32:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Lock "cinder-quobyte-4c766ee5-ab40-44b8-afa5-2fe06112825f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:32:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Deleting offline snapshot 4c766ee5-ab40-44b8-afa5-2fe06112825f of volume 94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:32:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] snapshot_file for this snap is: volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:32:18 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ab5f4f-ff9e-4b9d-b558-9f13655ecf82]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:18 devstack sudo[94043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f
Jul 06 15:32:18 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:19 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f" returned: 0 in 1.054s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94b1d772-6f00-482f-9a90-61cc4203beb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:32:19 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff813f5-0526-4199-a1a2-7f4f8abd97f7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:19 devstack sudo[94049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3
Jul 06 15:32:19 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:20 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3" returned: 0 in 0.912s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:20 devstack sudo[94054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f
Jul 06 15:32:20 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:21 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f" returned: 0 in 0.907s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:21 devstack sudo[94060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f
Jul 06 15:32:21 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:22 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3.4c766ee5-ab40-44b8-afa5-2fe06112825f" returned: 0 in 0.727s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Lock "cinder-quobyte-4c766ee5-ab40-44b8-afa5-2fe06112825f" released by "_delete_snapshot" :: held 3.722s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:32:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.494s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-df166f3c-9049-46a5-8c1a-087f46c31b46 req-f2ae9ff0-937a-49a0-84fe-b5a8abcdbbf5 tempest-TestShelveInstance-150764035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.941s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad014dd-d1e8-4c9d-9e39-019c4b069098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-474464e7-f088-4b70-ae99-0045f6227dce', 'volume_size': 2, 'source_volid': '94b1d772-6f00-482f-9a90-61cc4203beb3', 'source_volstatus': 'available'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54db06b2-6fbd-42a9-9a13-2f18cfe7521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:22 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Volume volume-474464e7-f088-4b70-ae99-0045f6227dce (474464e7-f088-4b70-ae99-0045f6227dce): created successfully
Jul 06 15:32:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54db06b2-6fbd-42a9-9a13-2f18cfe7521e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Flow 'volume_create_manager' (0c49682f-34f4-4886-bda9-eba8e684f9cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:32:22 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37d3e1c-b11f-4b4f-8606-0e4c13053d25]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-df166f3c-9049-46a5-8c1a-087f46c31b46 req-f2ae9ff0-937a-49a0-84fe-b5a8abcdbbf5 tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-623ec69b-6b02-4b29-9ad8-3bf2aca8fed7 tempest-VolumesCloneTest-431580592 None] Created volume successfully.
Jul 06 15:32:22 devstack sudo[94069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:32:22 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:23 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-df166f3c-9049-46a5-8c1a-087f46c31b46 req-f2ae9ff0-937a-49a0-84fe-b5a8abcdbbf5 tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 0 in 0.808s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-df166f3c-9049-46a5-8c1a-087f46c31b46 req-f2ae9ff0-937a-49a0-84fe-b5a8abcdbbf5 tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:23 devstack sudo[94073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:32:23 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Acquiring lock "cinder-474464e7-f088-4b70-ae99-0045f6227dce-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:32:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Lock "cinder-474464e7-f088-4b70-ae99-0045f6227dce-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:32:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Acquiring lock "cinder-quobyte-474464e7-f088-4b70-ae99-0045f6227dce" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:32:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Lock "cinder-quobyte-474464e7-f088-4b70-ae99-0045f6227dce" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:32:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d32ea6-69fe-45f6-a713-2493680e51ca]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:24 devstack sudo[94075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce
Jul 06 15:32:24 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:24 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-df166f3c-9049-46a5-8c1a-087f46c31b46 req-f2ae9ff0-937a-49a0-84fe-b5a8abcdbbf5 tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 1 in 1.229s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-df166f3c-9049-46a5-8c1a-087f46c31b46 req-f2ae9ff0-937a-49a0-84fe-b5a8abcdbbf5 tempest-TestShelveInstance-150764035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:32:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-df166f3c-9049-46a5-8c1a-087f46c31b46 req-f2ae9ff0-937a-49a0-84fe-b5a8abcdbbf5 tempest-TestShelveInstance-150764035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.137s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-df166f3c-9049-46a5-8c1a-087f46c31b46 req-f2ae9ff0-937a-49a0-84fe-b5a8abcdbbf5 tempest-TestShelveInstance-150764035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-919a4753-70be-471a-8bed-f5019004c1fe', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47f39a12-5ea0-4a41-a611-be7cd0ad314b', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:32:24 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-df166f3c-9049-46a5-8c1a-087f46c31b46 req-f2ae9ff0-937a-49a0-84fe-b5a8abcdbbf5 tempest-TestShelveInstance-150764035 None] attachment_update completed successfully.
Jul 06 15:32:25 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce" returned: 0 in 1.161s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:25 devstack sudo[94084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce
Jul 06 15:32:25 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:26 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-474464e7-f088-4b70-ae99-0045f6227dce" returned: 0 in 1.000s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Lock "cinder-quobyte-474464e7-f088-4b70-ae99-0045f6227dce" released by "delete_volume" :: held 2.209s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Created reservations ['6e2cb0d8-7e0f-4b66-bdb2-35d4b5cd439c', 'afaeb980-aafb-415d-b574-50fc474761dd', '991eb11d-f5f5-4663-9e79-7d8a5db67580', 'be2d8461-9ae8-4a39-9362-b6bb1ab2dbc0'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:26 devstack sudo[94110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:32:26 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:26 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.757s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:32:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Deleted volume successfully.
Jul 06 15:32:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d465ec9c-d685-459d-b3c3-e84b70248782 tempest-VolumesCloneTest-431580592 None] Lock "cinder-474464e7-f088-4b70-ae99-0045f6227dce-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:32:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Acquiring lock "cinder-94b1d772-6f00-482f-9a90-61cc4203beb3-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:32:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Lock "cinder-94b1d772-6f00-482f-9a90-61cc4203beb3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:32:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Acquiring lock "cinder-quobyte-94b1d772-6f00-482f-9a90-61cc4203beb3" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:32:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Lock "cinder-quobyte-94b1d772-6f00-482f-9a90-61cc4203beb3" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:32:27 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aa333a-8e27-4ca8-a1eb-2aac4c616843]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:27 devstack sudo[94180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3
Jul 06 15:32:27 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:28 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3" returned: 0 in 0.916s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:28 devstack sudo[94197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3
Jul 06 15:32:28 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:29 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-94b1d772-6f00-482f-9a90-61cc4203beb3" returned: 0 in 0.932s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Lock "cinder-quobyte-94b1d772-6f00-482f-9a90-61cc4203beb3" released by "delete_volume" :: held 1.914s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:32:29 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Created reservations ['e2717bf7-37e1-401f-a19f-438133b776ca', 'ffe78168-f9e2-4fe4-bc10-d455014ad8ec', 'fb770fda-670a-4081-87c4-679c7678da6f', '135af1ed-c087-4889-95bf-3eecb49deffd'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:32:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:32:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:32:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:29 devstack sudo[94235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:32:29 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:30 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.942s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:30 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:32:30 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Deleted volume successfully.
Jul 06 15:32:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-440036dc-76af-4983-a713-330e56644a3c tempest-VolumesCloneTest-431580592 None] Lock "cinder-94b1d772-6f00-482f-9a90-61cc4203beb3-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Flow 'volume_create_manager' (d251f41e-bc4f-4956-ba67-e9a64de62965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22533142-764d-43d3-94a5-2bcab668c1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22533142-764d-43d3-94a5-2bcab668c1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1853271091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe10d816-9dc9-44ae-aafe-8d422b06a4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e55105ee6d24381ba866d4a830d60d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:35Z,use_quota=True,user_id='2ff838df779d471485d85d4e1f598100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68d6ec6-05a4-472f-94ab-b5861bb25f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68d6ec6-05a4-472f-94ab-b5861bb25f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065e8ed4-a11d-4362-8fbc-37fdc0770ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065e8ed4-a11d-4362-8fbc-37fdc0770ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe10d816-9dc9-44ae-aafe-8d422b06a4d8', 'volume_name': 'volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8', 'volume_size': 2}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2187e4e7-9c39-45ce-beee-942c8b88d0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2187e4e7-9c39-45ce-beee-942c8b88d0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85dafc3f-727d-4d3e-b180-63eb07d513f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:34 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Volume fe10d816-9dc9-44ae-aafe-8d422b06a4d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8', 'volume_size': 2}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1853271091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe10d816-9dc9-44ae-aafe-8d422b06a4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e55105ee6d24381ba866d4a830d60d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:35Z,use_quota=True,user_id='2ff838df779d471485d85d4e1f598100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Creating volume fe10d816-9dc9-44ae-aafe-8d422b06a4d8 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:32:34 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:32:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8 2147483648 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:34 devstack sudo[94571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8 2147483648
Jul 06 15:32:34 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:36 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8 2147483648" returned: 0 in 1.256s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:36 devstack sudo[94577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8
Jul 06 15:32:36 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:37 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8" returned: 0 in 0.995s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:32:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85dafc3f-727d-4d3e-b180-63eb07d513f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8', 'volume_size': 2}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaeb79d3-cc8d-4ed8-8b57-db56cbc35707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:37 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Volume volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8 (fe10d816-9dc9-44ae-aafe-8d422b06a4d8): created successfully
Jul 06 15:32:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaeb79d3-cc8d-4ed8-8b57-db56cbc35707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Flow 'volume_create_manager' (d251f41e-bc4f-4956-ba67-e9a64de62965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:32:37 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ce0e2d68-b011-4549-97a3-a3f538c548ff tempest-VolumesCloneNegativeTest-1250969224 None] Created volume successfully.
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Acquiring lock "cinder-fe10d816-9dc9-44ae-aafe-8d422b06a4d8-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Lock "cinder-fe10d816-9dc9-44ae-aafe-8d422b06a4d8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Acquiring lock "cinder-quobyte-fe10d816-9dc9-44ae-aafe-8d422b06a4d8" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Lock "cinder-quobyte-fe10d816-9dc9-44ae-aafe-8d422b06a4d8" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b1b441-a60f-4116-b0d6-4d7da25067f4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:38 devstack sudo[94582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8
Jul 06 15:32:38 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Flow 'volume_create_manager' (e77b61b3-6c85-47bc-9dca-e74356bb05e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1468d034-0527-479d-8ce4-54383489147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1468d034-0527-479d-8ce4-54383489147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1800095169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17de595-55e2-4045-9375-53a93731900c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192cc68371824c069d4496f57cc0bf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:39Z,use_quota=True,user_id='fdf8018f0ce7405a98aec3d346e6c45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc5d484-e542-454e-99ca-81dc6d9a4ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc5d484-e542-454e-99ca-81dc6d9a4ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66cc7038-f378-4405-aca9-e52efd60e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66cc7038-f378-4405-aca9-e52efd60e490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17de595-55e2-4045-9375-53a93731900c', 'volume_name': 'volume-e17de595-55e2-4045-9375-53a93731900c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6770c22b-75a4-4e8d-8a86-af774f48af05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6770c22b-75a4-4e8d-8a86-af774f48af05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb3916a-5b3d-4d1a-b307-92287da3e29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:39 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Volume e17de595-55e2-4045-9375-53a93731900c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17de595-55e2-4045-9375-53a93731900c', 'volume_size': 1}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1800095169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17de595-55e2-4045-9375-53a93731900c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192cc68371824c069d4496f57cc0bf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:39Z,use_quota=True,user_id='fdf8018f0ce7405a98aec3d346e6c45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Creating volume e17de595-55e2-4045-9375-53a93731900c {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:32:39 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:39 devstack sudo[94584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c 1073741824
Jul 06 15:32:39 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:39 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8" returned: 0 in 1.494s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:39 devstack sudo[94590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8
Jul 06 15:32:40 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:40 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c 1073741824" returned: 0 in 1.562s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:40 devstack sudo[94596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c
Jul 06 15:32:40 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:41 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fe10d816-9dc9-44ae-aafe-8d422b06a4d8" returned: 0 in 1.314s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Lock "cinder-quobyte-fe10d816-9dc9-44ae-aafe-8d422b06a4d8" released by "delete_volume" :: held 2.993s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Created reservations ['b5217f3f-5282-4ab6-8db8-e379c23e62fd', 'd5a69bd1-d8fa-413a-8c18-ba16df2825f0', '60ca96f8-3c06-4ce0-9c5a-7c190dcd3df8', '89628e19-a12e-4fea-91af-a30986512ae5'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:41 devstack sudo[94599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:32:41 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:41 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c" returned: 0 in 1.148s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] <== create_volume: return (2818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.821s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb3916a-5b3d-4d1a-b307-92287da3e29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17de595-55e2-4045-9375-53a93731900c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97629857-db90-4178-8126-0d1f197f9701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:41 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Volume volume-e17de595-55e2-4045-9375-53a93731900c (e17de595-55e2-4045-9375-53a93731900c): created successfully
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97629857-db90-4178-8126-0d1f197f9701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Flow 'volume_create_manager' (e77b61b3-6c85-47bc-9dca-e74356bb05e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:32:41 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-69dfa993-e599-4498-b68f-41e8a3657bf9 tempest-AttachVolumeTestJSON-402367968 None] Created volume successfully.
Jul 06 15:32:42 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.299s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:42 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:32:42 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Deleted volume successfully.
Jul 06 15:32:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2fe8be88-f1a3-404f-b014-fd00729f6146 tempest-VolumesCloneNegativeTest-1250969224 None] Lock "cinder-fe10d816-9dc9-44ae-aafe-8d422b06a4d8-delete_volume" released by "delete_volume" :: held 4.688s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:32:47 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=59,cinder:DELETE=6,cinder:UPDATE=64,cinder:INSERT=24 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:32:47 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=48,cinder:INSERT=17,cinder:UPDATE=60,cinder:DELETE=6 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:32:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-92c35305-cb4b-486c-9184-751d8d6dba09 req-19add26c-7bfe-4dcd-938d-7c63b6b87df4 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-92c35305-cb4b-486c-9184-751d8d6dba09 req-19add26c-7bfe-4dcd-938d-7c63b6b87df4 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:47 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[db483ac8-d2cb-48a7-9c5c-8d773c2bbbee]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:32:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-92c35305-cb4b-486c-9184-751d8d6dba09 req-19add26c-7bfe-4dcd-938d-7c63b6b87df4 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:47 devstack sudo[94655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c
Jul 06 15:32:47 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:48 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-92c35305-cb4b-486c-9184-751d8d6dba09 req-19add26c-7bfe-4dcd-938d-7c63b6b87df4 tempest-AttachVolumeTestJSON-402367968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c" returned: 0 in 1.002s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-92c35305-cb4b-486c-9184-751d8d6dba09 req-19add26c-7bfe-4dcd-938d-7c63b6b87df4 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.030s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-92c35305-cb4b-486c-9184-751d8d6dba09 req-19add26c-7bfe-4dcd-938d-7c63b6b87df4 tempest-AttachVolumeTestJSON-402367968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-e17de595-55e2-4045-9375-53a93731900c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b93847c-1b5f-436c-89c4-2f103556ebbb', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:32:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-92c35305-cb4b-486c-9184-751d8d6dba09 req-19add26c-7bfe-4dcd-938d-7c63b6b87df4 tempest-AttachVolumeTestJSON-402367968 None] attachment_update completed successfully.
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Flow 'volume_create_manager' (aa18277a-24df-4f5f-b3d3-082ce5227cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e71e637-b07e-4c47-b722-0e63d98fdd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e71e637-b07e-4c47-b722-0e63d98fdd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1565156842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192cc68371824c069d4496f57cc0bf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:54Z,use_quota=True,user_id='fdf8018f0ce7405a98aec3d346e6c45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccea38d-cc10-47da-8608-9e438df61ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccea38d-cc10-47da-8608-9e438df61ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169a8982-a51f-4377-8dd4-98af8bb7dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169a8982-a51f-4377-8dd4-98af8bb7dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043', 'volume_name': 'volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5e31ce-1cf5-4167-bc88-8f7eba13bae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5e31ce-1cf5-4167-bc88-8f7eba13bae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09eb8878-6624-4e97-9d0b-207227cd14b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:54 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Volume cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043', 'volume_size': 1}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1565156842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192cc68371824c069d4496f57cc0bf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:54Z,use_quota=True,user_id='fdf8018f0ce7405a98aec3d346e6c45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Creating volume cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:32:54 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:32:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:54 devstack sudo[94761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043 1073741824
Jul 06 15:32:54 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:55 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043 1073741824" returned: 0 in 1.057s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:32:55 devstack sudo[94768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043
Jul 06 15:32:55 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:32:56 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root
Jul 06 15:32:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043" returned: 0 in 0.842s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:32:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:32:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:32:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09eb8878-6624-4e97-9d0b-207227cd14b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce7595c-0554-44b2-815b-f994f479ec27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:32:56 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Volume volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043 (cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043): created successfully
Jul 06 15:32:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce7595c-0554-44b2-815b-f994f479ec27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:32:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Flow 'volume_create_manager' (aa18277a-24df-4f5f-b3d3-082ce5227cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:32:56 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e1bac61e-4108-453b-a411-78796f41a475 tempest-AttachVolumeTestJSON-402367968 None] Created volume successfully.
Jul 06 15:33:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-fa53bc02-e2ff-40da-b2f9-71e62a6c3815 req-6302a6f2-9033-4042-8159-dfe3f043062c tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-fa53bc02-e2ff-40da-b2f9-71e62a6c3815 req-6302a6f2-9033-4042-8159-dfe3f043062c tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:00 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a282921-5048-48af-9412-99126040adf4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-fa53bc02-e2ff-40da-b2f9-71e62a6c3815 req-6302a6f2-9033-4042-8159-dfe3f043062c tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:00 devstack sudo[94824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043
Jul 06 15:33:00 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:01 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-fa53bc02-e2ff-40da-b2f9-71e62a6c3815 req-6302a6f2-9033-4042-8159-dfe3f043062c tempest-AttachVolumeTestJSON-402367968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043" returned: 0 in 0.942s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-fa53bc02-e2ff-40da-b2f9-71e62a6c3815 req-6302a6f2-9033-4042-8159-dfe3f043062c tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.966s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-fa53bc02-e2ff-40da-b2f9-71e62a6c3815 req-6302a6f2-9033-4042-8159-dfe3f043062c tempest-AttachVolumeTestJSON-402367968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bde272ed-ac53-4680-841b-e8c6452b73cb', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:33:01 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-fa53bc02-e2ff-40da-b2f9-71e62a6c3815 req-6302a6f2-9033-4042-8159-dfe3f043062c tempest-AttachVolumeTestJSON-402367968 None] attachment_update completed successfully.
Jul 06 15:33:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:33:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:33:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:33:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:06 devstack sudo[94906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:33:06 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:07 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.350s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:08 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:33:08 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:33:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:33:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:33:09 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-8b3868cd-c808-40c5-ac3b-66e801b9b3de req-75fc373d-ab2a-4cb3-8e99-14cf8171ac9e tempest-AttachVolumeTestJSON-402367968 None] Terminate volume connection completed successfully.
Jul 06 15:33:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-8b3868cd-c808-40c5-ac3b-66e801b9b3de req-75fc373d-ab2a-4cb3-8e99-14cf8171ac9e tempest-AttachVolumeTestJSON-402367968 None] Deleting attachment 9b93847c-1b5f-436c-89c4-2f103556ebbb. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:33:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-2e8907ba-f191-4ef6-88ba-7de963194e22 req-1aecbf59-6828-47b4-8453-19926b20c103 tempest-TestShelveInstance-150764035 None] Terminate volume connection completed successfully.
Jul 06 15:33:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-2e8907ba-f191-4ef6-88ba-7de963194e22 req-1aecbf59-6828-47b4-8453-19926b20c103 tempest-TestShelveInstance-150764035 None] Deleting attachment 47f39a12-5ea0-4a41-a611-be7cd0ad314b. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:33:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-dd18c9eb-45c4-4cfd-a17f-79261575ca3c req-24f31355-55f2-43e4-b3c1-59df50a7269d tempest-AttachVolumeTestJSON-402367968 None] Terminate volume connection completed successfully.
Jul 06 15:33:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-dd18c9eb-45c4-4cfd-a17f-79261575ca3c req-24f31355-55f2-43e4-b3c1-59df50a7269d tempest-AttachVolumeTestJSON-402367968 None] Deleting attachment bde272ed-ac53-4680-841b-e8c6452b73cb. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:33:13 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:33:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Flow 'volume_create_manager' (7687be18-cdc1-4ef1-b4ca-612b016a32fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:33:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5458c0c2-37e7-4d6b-9ee5-eb7322165dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5458c0c2-37e7-4d6b-9ee5-eb7322165dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-733206039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803168e3-3abe-4a83-851d-1ed31ed974a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78571c94fd33478a805cafd9f39f592d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:14Z,use_quota=True,user_id='5007ec1905a24f98bb194aa61db6fe09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb221540-b46d-490f-b456-2274919f9712),volume_type_id=cb221540-b46d-490f-b456-2274919f9712)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0adc3dde-23f6-4c7b-9c15-b0243574cbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0adc3dde-23f6-4c7b-9c15-b0243574cbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8034b1-4a2e-42d6-94e6-9b53a8d26054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8034b1-4a2e-42d6-94e6-9b53a8d26054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803168e3-3abe-4a83-851d-1ed31ed974a1', 'volume_name': 'volume-803168e3-3abe-4a83-851d-1ed31ed974a1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091ffeb5-d69a-4dc4-9439-8bbbca8b752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091ffeb5-d69a-4dc4-9439-8bbbca8b752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af5d736-a15f-4447-a1a7-cffc0e95ff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:14 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Volume 803168e3-3abe-4a83-851d-1ed31ed974a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803168e3-3abe-4a83-851d-1ed31ed974a1', 'volume_size': 1}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-733206039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803168e3-3abe-4a83-851d-1ed31ed974a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78571c94fd33478a805cafd9f39f592d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:14Z,use_quota=True,user_id='5007ec1905a24f98bb194aa61db6fe09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb221540-b46d-490f-b456-2274919f9712),volume_type_id=cb221540-b46d-490f-b456-2274919f9712)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Creating volume 803168e3-3abe-4a83-851d-1ed31ed974a1 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:33:14 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:14 devstack sudo[94943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1 1073741824
Jul 06 15:33:14 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Flow 'volume_create_manager' (e30df128-81e6-4344-9468-6fbf1929092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b3b9b4-0ccc-4b34-b559-ea8e38437991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b3b9b4-0ccc-4b34-b559-ea8e38437991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-157799392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78571c94fd33478a805cafd9f39f592d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:14Z,use_quota=True,user_id='5007ec1905a24f98bb194aa61db6fe09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(371ea217-1abc-450c-9a19-267ab4e7fe78),volume_type_id=371ea217-1abc-450c-9a19-267ab4e7fe78)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca1ba6a-c0a1-45bb-9280-0a267a6a0516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca1ba6a-c0a1-45bb-9280-0a267a6a0516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281afa83-7a8b-4762-85d7-519c889cee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281afa83-7a8b-4762-85d7-519c889cee82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb', 'volume_name': 'volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71639c8f-1c49-4230-bb6b-4c0c5ff6b6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71639c8f-1c49-4230-bb6b-4c0c5ff6b6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5de1aef-9501-43cd-8ecc-539005a1c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:14 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Volume 751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb', 'volume_size': 1}
Jul 06 15:33:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:15 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:33:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Flow 'volume_create_manager' (7f11f2ac-1453-4d6e-8f6b-1126b6b0ff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:33:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1109bf02-2b93-4cbf-97c3-2b0cc14e6f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1109bf02-2b93-4cbf-97c3-2b0cc14e6f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-423363110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05a6e65-283a-4b5c-b8b3-5826cf28813f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78571c94fd33478a805cafd9f39f592d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:16Z,use_quota=True,user_id='5007ec1905a24f98bb194aa61db6fe09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c79041b0-b2db-4cf9-b834-06435f0e6dd3),volume_type_id=c79041b0-b2db-4cf9-b834-06435f0e6dd3)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d78808-6f3c-4ffa-9c2d-6045df2b1eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d78808-6f3c-4ffa-9c2d-6045df2b1eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfe8deb-c186-4243-adbe-6fba54392347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:15 devstack cinder-volume[86249]: DEBUG cinder.image.glance [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Creating Keystone auth plugin from conf {{(pid=86249) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 15:33:15 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1 1073741824" returned: 0 in 1.820s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:15 devstack sudo[94970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1
Jul 06 15:33:15 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfe8deb-c186-4243-adbe-6fba54392347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a05a6e65-283a-4b5c-b8b3-5826cf28813f', 'volume_name': 'volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f', 'volume_size': 1, 'image_id': 'de00452d-641d-4c57-880e-ad12e6bf71d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de00452d-641d-4c57-880e-ad12e6bf71d7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1631137934', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78571c94fd33478a805cafd9f39f592d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de00452d-641d-4c57-880e-ad12e6bf71d7', 'created_at': datetime.datetime(2026, 7, 6, 13, 33, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 33, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de00452d-641d-4c57-880e-ad12e6bf71d7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8efc500>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75228031-351f-4a24-afd5-6891f311ca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75228031-351f-4a24-afd5-6891f311ca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe50df7-60e9-4434-890f-42f818b01129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:16 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Volume a05a6e65-283a-4b5c-b8b3-5826cf28813f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f', 'volume_size': 1, 'image_id': 'de00452d-641d-4c57-880e-ad12e6bf71d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de00452d-641d-4c57-880e-ad12e6bf71d7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1631137934', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78571c94fd33478a805cafd9f39f592d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de00452d-641d-4c57-880e-ad12e6bf71d7', 'created_at': datetime.datetime(2026, 7, 6, 13, 33, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 33, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de00452d-641d-4c57-880e-ad12e6bf71d7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8efc500>}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Trying to clone a05a6e65-283a-4b5c-b8b3-5826cf28813f from image de00452d-641d-4c57-880e-ad12e6bf71d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/de00452d-641d-4c57-880e-ad12e6bf71d7', 'metadata': {}}]). {{(pid=86249) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 15:33:16 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1" returned: 0 in 0.717s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] <== create_volume: return (2593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.595s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.021s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-157799392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78571c94fd33478a805cafd9f39f592d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:14Z,use_quota=True,user_id='5007ec1905a24f98bb194aa61db6fe09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(371ea217-1abc-450c-9a19-267ab4e7fe78),volume_type_id=371ea217-1abc-450c-9a19-267ab4e7fe78)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Creating volume 751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:33:16 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:16 devstack sudo[94978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb 1073741824
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af5d736-a15f-4447-a1a7-cffc0e95ff39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803168e3-3abe-4a83-851d-1ed31ed974a1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:16 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad016ac7-04cb-466d-a16d-22b9d3b02c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:16 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Volume volume-803168e3-3abe-4a83-851d-1ed31ed974a1 (803168e3-3abe-4a83-851d-1ed31ed974a1): created successfully
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad016ac7-04cb-466d-a16d-22b9d3b02c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Flow 'volume_create_manager' (7687be18-cdc1-4ef1-b4ca-612b016a32fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:33:16 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0dfeb893-ad7a-4bb2-aeda-d6266de1166d tempest-TestInstancesWithCinderVolumes-225716769 None] Created volume successfully.
Jul 06 15:33:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-bd84f4ab-4dd3-4d73-94c2-f03072e20967 req-3f49f1d3-77e7-41b8-8de8-d8d55802b83e tempest-TestShelveInstance-150764035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:17 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb 1073741824" returned: 0 in 1.242s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:17 devstack sudo[95010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb
Jul 06 15:33:17 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb" returned: 0 in 0.850s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:18 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:33:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-bd84f4ab-4dd3-4d73-94c2-f03072e20967 req-3f49f1d3-77e7-41b8-8de8-d8d55802b83e tempest-TestShelveInstance-150764035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.190s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5de1aef-9501-43cd-8ecc-539005a1c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fe78af-7d3f-4f44-8528-49f5fa149f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:18 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Volume volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb (751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb): created successfully
Jul 06 15:33:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fe78af-7d3f-4f44-8528-49f5fa149f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Flow 'volume_create_manager' (e30df128-81e6-4344-9468-6fbf1929092b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:33:18 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c68d266-3442-416e-b4fe-ce3376a4a520]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-bd84f4ab-4dd3-4d73-94c2-f03072e20967 req-3f49f1d3-77e7-41b8-8de8-d8d55802b83e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:18 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-24d0c667-8a8e-4502-8dff-3e35211b1eb1 tempest-TestInstancesWithCinderVolumes-225716769 None] Created volume successfully.
Jul 06 15:33:18 devstack sudo[95015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:33:18 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:19 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-bd84f4ab-4dd3-4d73-94c2-f03072e20967 req-3f49f1d3-77e7-41b8-8de8-d8d55802b83e tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 0 in 0.750s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-bd84f4ab-4dd3-4d73-94c2-f03072e20967 req-3f49f1d3-77e7-41b8-8de8-d8d55802b83e tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:19 devstack sudo[95020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:33:19 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:19 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD, size 20.69 MB, duration 3.77 sec {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 15:33:19 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Image download 20.69 MB at 5.49 MB/s
Jul 06 15:33:19 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe83f6a-d1a4-4343-839a-dfdef56eed88]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:19 devstack sudo[95022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD
Jul 06 15:33:19 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:20 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-bd84f4ab-4dd3-4d73-94c2-f03072e20967 req-3f49f1d3-77e7-41b8-8de8-d8d55802b83e tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 1 in 0.777s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-bd84f4ab-4dd3-4d73-94c2-f03072e20967 req-3f49f1d3-77e7-41b8-8de8-d8d55802b83e tempest-TestShelveInstance-150764035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:33:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-bd84f4ab-4dd3-4d73-94c2-f03072e20967 req-3f49f1d3-77e7-41b8-8de8-d8d55802b83e tempest-TestShelveInstance-150764035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.608s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-bd84f4ab-4dd3-4d73-94c2-f03072e20967 req-3f49f1d3-77e7-41b8-8de8-d8d55802b83e tempest-TestShelveInstance-150764035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-919a4753-70be-471a-8bed-f5019004c1fe', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffbe1f44-0e9a-4f6f-b7c4-22ffddf90086', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:33:20 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-bd84f4ab-4dd3-4d73-94c2-f03072e20967 req-3f49f1d3-77e7-41b8-8de8-d8d55802b83e tempest-TestShelveInstance-150764035 None] attachment_update completed successfully.
Jul 06 15:33:20 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:20 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Temporary image de00452d-641d-4c57-880e-ad12e6bf71d7 is fetched for user 5007ec1905a24f98bb194aa61db6fe09. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 15:33:20 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[008910ac-e3f6-4ed7-bb72-20661b016229]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:20 devstack sudo[95030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD
Jul 06 15:33:20 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:21 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-423363110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05a6e65-283a-4b5c-b8b3-5826cf28813f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78571c94fd33478a805cafd9f39f592d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:16Z,use_quota=True,user_id='5007ec1905a24f98bb194aa61db6fe09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c79041b0-b2db-4cf9-b834-06435f0e6dd3),volume_type_id=c79041b0-b2db-4cf9-b834-06435f0e6dd3)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Creating volume a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:33:21 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:33:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:21 devstack sudo[95035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f 1073741824
Jul 06 15:33:21 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:22 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f 1073741824" returned: 0 in 0.809s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:22 devstack sudo[95041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f
Jul 06 15:33:22 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:22 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f" returned: 0 in 0.667s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:33:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:22 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Attempting download of de00452d-641d-4c57-880e-ad12e6bf71d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/de00452d-641d-4c57-880e-ad12e6bf71d7', 'metadata': {}}])) to volume a05a6e65-283a-4b5c-b8b3-5826cf28813f. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 15:33:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3443c55-975d-48d4-a651-740c07678333]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de00452d-641d-4c57-880e-ad12e6bf71d7_5u80r3vl {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:23 devstack sudo[95050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de00452d-641d-4c57-880e-ad12e6bf71d7_5u80r3vl
Jul 06 15:33:23 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "cinder-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:33:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:33:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "cinder-quobyte-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:33:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-quobyte-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043" acquired by "delete_volume" :: waited 0.035s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:33:23 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de00452d-641d-4c57-880e-ad12e6bf71d7_5u80r3vl" returned: 0 in 0.884s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de00452d-641d-4c57-880e-ad12e6bf71d7_5u80r3vl {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8abc62-43c6-468f-b02a-012645b96969]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:24 devstack sudo[95054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de00452d-641d-4c57-880e-ad12e6bf71d7_5u80r3vl
Jul 06 15:33:24 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:24 devstack sudo[95055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043
Jul 06 15:33:24 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:24 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de00452d-641d-4c57-880e-ad12e6bf71d7_5u80r3vl" returned: 1 in 0.800s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de00452d-641d-4c57-880e-ad12e6bf71d7_5u80r3vl' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:33:24 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e2b79b-1c62-45ef-97ab-f43c4b951c6a]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:24 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043" returned: 0 in 0.840s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:24 devstack sudo[95064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043
Jul 06 15:33:24 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:24 devstack sudo[95063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD
Jul 06 15:33:24 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:25 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] de00452d-641d-4c57-880e-ad12e6bf71d7 was qcow2, converting to raw {{(pid=86249) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 15:33:25 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043" returned: 0 in 0.796s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:25 devstack sudo[95072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f
Jul 06 15:33:25 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-quobyte-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043" released by "delete_volume" :: held 1.711s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Created reservations ['211a6a03-7276-4efe-81e3-312643266054', 'a7bf2fa5-1635-4729-86d5-7732f4d560e1', '565180d4-d175-49e5-9632-279f27ba8c4e', 'ace27a0a-bff6-40bb-8a56-7e44e23de41c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:25 devstack sudo[95074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:33:25 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "cinder-e17de595-55e2-4045-9375-53a93731900c-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:33:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-e17de595-55e2-4045-9375-53a93731900c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:33:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "cinder-quobyte-e17de595-55e2-4045-9375-53a93731900c" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:33:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-quobyte-e17de595-55e2-4045-9375-53a93731900c" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:33:26 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[743a53ec-c95d-439e-b237-70b55858ec01]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:26 devstack sudo[95076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c
Jul 06 15:33:26 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:26 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.997s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:26 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:33:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Deleted volume successfully.
Jul 06 15:33:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8770251d-059a-4d88-8d87-7149edf72524 tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-cd8e1547-29fb-4c8c-8a4c-3d05a7e0e043-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:33:27 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c" returned: 0 in 0.879s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:27 devstack sudo[95094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c
Jul 06 15:33:27 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:27 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e17de595-55e2-4045-9375-53a93731900c" returned: 0 in 0.677s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-quobyte-e17de595-55e2-4045-9375-53a93731900c" released by "delete_volume" :: held 1.653s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Created reservations ['6056fbdf-c8ea-4411-ad69-10855aa04370', '957d07db-c925-4e12-88f1-b2a4d87b442b', '230e6019-fd35-43e5-8712-4caa5726d27c', '8bb9d442-14f5-49a7-bf43-23db7b915530'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:33:28 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f" returned: 0 in 2.410s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de00452d-641d-4c57-880e-ad12e6bf71d7_ivd6ikiqdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:33:28 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Converted 112.00 MB image at 46.45 MB/s
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:28 devstack sudo[95097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f 1G
Jul 06 15:33:28 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:28 devstack sudo[95101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:33:28 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "cinder-040b5282-18c9-4994-bae3-7d877dfd2576-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-040b5282-18c9-4994-bae3-7d877dfd2576-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "cinder-quobyte-040b5282-18c9-4994-bae3-7d877dfd2576" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-quobyte-040b5282-18c9-4994-bae3-7d877dfd2576" acquired by "delete_volume" :: waited 0.038s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb217bc8-0e7e-407b-b818-366ccb5a202c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:28 devstack sudo[95107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576
Jul 06 15:33:28 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:28 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f 1G" returned: 0 in 0.943s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:29 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.929s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84bc3ae-74bd-4eec-a26a-17aae599a3ad]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:29 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Deleted volume successfully.
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d576212c-2360-43c7-927d-1010904e5c19 tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-e17de595-55e2-4045-9375-53a93731900c-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:33:29 devstack sudo[95176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f
Jul 06 15:33:29 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Flow 'volume_create_manager' (6af1f269-c34c-4eb8-89a4-a40d6bd8e577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa62ba3-f58d-4f08-b160-2af77f85217b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa62ba3-f58d-4f08-b160-2af77f85217b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1497634295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43a67cf-72be-4d09-b1fd-ac87cb17bfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb953ebe2d704ddbbb76386a23665f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:29Z,use_quota=True,user_id='a6844e2faead4b5493e349bfae34b5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18963382-eceb-465f-876e-746e4f1098f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18963382-eceb-465f-876e-746e4f1098f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531e2eaa-9083-46ea-994d-263c0fc0909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531e2eaa-9083-46ea-994d-263c0fc0909f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c43a67cf-72be-4d09-b1fd-ac87cb17bfef', 'volume_name': 'volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8d9b66-e4ae-48d8-a0c7-a2952df993aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8d9b66-e4ae-48d8-a0c7-a2952df993aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13441137-5b90-49a3-948f-87e5bd376c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:29 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Volume c43a67cf-72be-4d09-b1fd-ac87cb17bfef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef', 'volume_size': 1}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1497634295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43a67cf-72be-4d09-b1fd-ac87cb17bfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb953ebe2d704ddbbb76386a23665f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:29Z,use_quota=True,user_id='a6844e2faead4b5493e349bfae34b5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Creating volume c43a67cf-72be-4d09-b1fd-ac87cb17bfef {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:33:29 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:29 devstack sudo[95178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef 1073741824
Jul 06 15:33:29 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:29 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576" returned: 0 in 1.033s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:29 devstack sudo[95187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576
Jul 06 15:33:29 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:29 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f" returned: 0 in 0.850s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:30 devstack sudo[95189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f
Jul 06 15:33:30 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:30 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef 1073741824" returned: 0 in 1.248s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:30 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-040b5282-18c9-4994-bae3-7d877dfd2576" returned: 0 in 0.885s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-quobyte-040b5282-18c9-4994-bae3-7d877dfd2576" released by "delete_volume" :: held 1.994s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:30 devstack sudo[95230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef
Jul 06 15:33:30 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Created reservations ['637a4609-c6d4-45a7-b259-5e24a7ef73f9', '698c9c4c-1115-45f3-a0e4-5b15296b9b21', '768949af-096f-4314-93a3-84775b878ad6', '25579edf-d9a5-4164-9b73-7eb06f7ade8f'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:31 devstack sudo[95241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:33:31 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:31 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f" returned: 1 in 1.148s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Downloaded image de00452d-641d-4c57-880e-ad12e6bf71d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/de00452d-641d-4c57-880e-ad12e6bf71d7', 'metadata': {}}])) to volume a05a6e65-283a-4b5c-b8b3-5826cf28813f successfully. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Temporary image de00452d-641d-4c57-880e-ad12e6bf71d7 for user 5007ec1905a24f98bb194aa61db6fe09 is deleted. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Marking volume a05a6e65-283a-4b5c-b8b3-5826cf28813f as bootable. {{(pid=86249) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Copying metadata from image de00452d-641d-4c57-880e-ad12e6bf71d7 to a05a6e65-283a-4b5c-b8b3-5826cf28813f. {{(pid=86249) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Creating volume glance metadata for volume a05a6e65-283a-4b5c-b8b3-5826cf28813f backed by image de00452d-641d-4c57-880e-ad12e6bf71d7 with: {'image_id': 'de00452d-641d-4c57-880e-ad12e6bf71d7', 'image_name': 'tempest-scenario-img--1631137934', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86249) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe50df7-60e9-4434-890f-42f818b01129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f', 'volume_size': 1, 'image_id': 'de00452d-641d-4c57-880e-ad12e6bf71d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de00452d-641d-4c57-880e-ad12e6bf71d7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1631137934', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78571c94fd33478a805cafd9f39f592d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de00452d-641d-4c57-880e-ad12e6bf71d7', 'created_at': datetime.datetime(2026, 7, 6, 13, 33, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 33, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de00452d-641d-4c57-880e-ad12e6bf71d7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8efc500>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de14c2b1-8c0b-418b-a924-bc394820b2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:31 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Volume volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f (a05a6e65-283a-4b5c-b8b3-5826cf28813f): created successfully
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de14c2b1-8c0b-418b-a924-bc394820b2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Flow 'volume_create_manager' (7f11f2ac-1453-4d6e-8f6b-1126b6b0ff86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:33:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a2f0a6b5-ec94-4cef-89be-40e1cd54e35b tempest-TestInstancesWithCinderVolumes-225716769 None] Created volume successfully.
Jul 06 15:33:31 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef" returned: 0 in 0.881s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13441137-5b90-49a3-948f-87e5bd376c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf778ee-8711-4637-be05-ec7dcde29dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:31 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Volume volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef (c43a67cf-72be-4d09-b1fd-ac87cb17bfef): created successfully
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf778ee-8711-4637-be05-ec7dcde29dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Flow 'volume_create_manager' (6af1f269-c34c-4eb8-89a4-a40d6bd8e577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:33:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7d2ca522-885c-4e9d-b96d-c2950b8d63e9 tempest-AttachVolumeNegativeTest-2009578222 None] Created volume successfully.
Jul 06 15:33:31 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.882s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:33:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Deleted volume successfully.
Jul 06 15:33:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-67ec7b50-7585-4609-920d-b7487f84a95d tempest-AttachVolumeTestJSON-402367968 None] Lock "cinder-040b5282-18c9-4994-bae3-7d877dfd2576-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:33:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-58e87f82-20ee-471f-bcc9-ff680496b82d req-6d66847e-1031-4c35-b3a5-0d3b7a500692 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-58e87f82-20ee-471f-bcc9-ff680496b82d req-6d66847e-1031-4c35-b3a5-0d3b7a500692 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:35 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dc1edc-3bd3-4fcd-baa5-0a74284d9d5b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-58e87f82-20ee-471f-bcc9-ff680496b82d req-6d66847e-1031-4c35-b3a5-0d3b7a500692 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:35 devstack sudo[95601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef
Jul 06 15:33:35 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:36 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-58e87f82-20ee-471f-bcc9-ff680496b82d req-6d66847e-1031-4c35-b3a5-0d3b7a500692 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef" returned: 0 in 1.001s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-58e87f82-20ee-471f-bcc9-ff680496b82d req-6d66847e-1031-4c35-b3a5-0d3b7a500692 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.029s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-58e87f82-20ee-471f-bcc9-ff680496b82d req-6d66847e-1031-4c35-b3a5-0d3b7a500692 tempest-AttachVolumeNegativeTest-2009578222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8442ccd-54bf-47b4-9f1a-46b47ea28af5', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:33:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-58e87f82-20ee-471f-bcc9-ff680496b82d req-6d66847e-1031-4c35-b3a5-0d3b7a500692 tempest-AttachVolumeNegativeTest-2009578222 None] attachment_update completed successfully.
Jul 06 15:33:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-5259b5d0-da1c-41ed-aec1-5ce8f076e936 req-8efe43a8-d8da-4e7c-88c3-1a81822f2b9d tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-5259b5d0-da1c-41ed-aec1-5ce8f076e936 req-8efe43a8-d8da-4e7c-88c3-1a81822f2b9d tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a28c234-0898-4412-a2f2-998e1640481b]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-5259b5d0-da1c-41ed-aec1-5ce8f076e936 req-8efe43a8-d8da-4e7c-88c3-1a81822f2b9d tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:40 devstack sudo[95629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f
Jul 06 15:33:40 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:41 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-5259b5d0-da1c-41ed-aec1-5ce8f076e936 req-8efe43a8-d8da-4e7c-88c3-1a81822f2b9d tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f" returned: 0 in 1.713s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-5259b5d0-da1c-41ed-aec1-5ce8f076e936 req-8efe43a8-d8da-4e7c-88c3-1a81822f2b9d tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:41 devstack sudo[95634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f
Jul 06 15:33:41 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:42 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-5259b5d0-da1c-41ed-aec1-5ce8f076e936 req-8efe43a8-d8da-4e7c-88c3-1a81822f2b9d tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f" returned: 1 in 1.301s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-5259b5d0-da1c-41ed-aec1-5ce8f076e936 req-8efe43a8-d8da-4e7c-88c3-1a81822f2b9d tempest-TestInstancesWithCinderVolumes-225716769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:33:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-5259b5d0-da1c-41ed-aec1-5ce8f076e936 req-8efe43a8-d8da-4e7c-88c3-1a81822f2b9d tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.094s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-5259b5d0-da1c-41ed-aec1-5ce8f076e936 req-8efe43a8-d8da-4e7c-88c3-1a81822f2b9d tempest-TestInstancesWithCinderVolumes-225716769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d073c3c-5a78-4efe-b9d4-9a256b67a9db', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:33:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-5259b5d0-da1c-41ed-aec1-5ce8f076e936 req-8efe43a8-d8da-4e7c-88c3-1a81822f2b9d tempest-TestInstancesWithCinderVolumes-225716769 None] attachment_update completed successfully.
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Flow 'volume_create_manager' (6023b356-0635-4d76-ae48-af2e1fc52559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbcfa7d-8f39-42ef-b440-d9a6e63c9b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbcfa7d-8f39-42ef-b440-d9a6e63c9b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-909927643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab55495-49a1-45eb-a406-268e062d895f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522f2672efa64560aff8afcaf54268d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:45Z,use_quota=True,user_id='913bcc7c4137453c92663f4e506ab3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73d8dcc-1786-49df-b056-dd744d2cb9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73d8dcc-1786-49df-b056-dd744d2cb9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8113e21-df26-48f0-8594-5cf56e2a147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8113e21-df26-48f0-8594-5cf56e2a147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab55495-49a1-45eb-a406-268e062d895f', 'volume_name': 'volume-bab55495-49a1-45eb-a406-268e062d895f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf78f7fd-0d1d-4ebf-b58f-0295439c3c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf78f7fd-0d1d-4ebf-b58f-0295439c3c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d61ee91-45eb-4fbe-aab8-d261e75c7072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:44 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Volume bab55495-49a1-45eb-a406-268e062d895f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab55495-49a1-45eb-a406-268e062d895f', 'volume_size': 1}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-909927643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab55495-49a1-45eb-a406-268e062d895f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522f2672efa64560aff8afcaf54268d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:45Z,use_quota=True,user_id='913bcc7c4137453c92663f4e506ab3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Creating volume bab55495-49a1-45eb-a406-268e062d895f {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:33:44 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:33:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:44 devstack sudo[95639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f 1073741824
Jul 06 15:33:44 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:45 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f 1073741824" returned: 0 in 1.130s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:46 devstack sudo[95648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f
Jul 06 15:33:46 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:46 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f" returned: 0 in 0.965s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:33:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d61ee91-45eb-4fbe-aab8-d261e75c7072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab55495-49a1-45eb-a406-268e062d895f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a7ae39-3b73-4bd9-9399-5b7878e30e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:33:47 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Volume volume-bab55495-49a1-45eb-a406-268e062d895f (bab55495-49a1-45eb-a406-268e062d895f): created successfully
Jul 06 15:33:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a7ae39-3b73-4bd9-9399-5b7878e30e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:33:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Flow 'volume_create_manager' (6023b356-0635-4d76-ae48-af2e1fc52559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:33:47 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-968aa8e2-e0bb-4b4f-acaa-2c7359362492 req-5f41f24e-12bd-4c76-987e-846b99894c43 tempest-VolumesSnapshotsTestJSON-897913868 None] Created volume successfully.
Jul 06 15:33:48 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=59,cinder:UPDATE=45,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:33:48 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=67,cinder:UPDATE=59,cinder:DELETE=4,cinder:INSERT=11 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:33:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:33:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:33:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Creating offline snapshot 2ffcf376-67e6-4044-9f4c-492f59fa0762 of volume bab55495-49a1-45eb-a406-268e062d895f {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:33:48 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb9ad38-88c7-4df0-aef2-6789c098c03c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:48 devstack sudo[95723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f
Jul 06 15:33:48 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:49 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f" returned: 0 in 1.020s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:49 devstack sudo[95755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762 1G
Jul 06 15:33:49 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:50 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762 1G" returned: 0 in 0.855s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab55495-49a1-45eb-a406-268e062d895f -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:50 devstack sudo[95762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab55495-49a1-45eb-a406-268e062d895f -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762
Jul 06 15:33:50 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab55495-49a1-45eb-a406-268e062d895f -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762" returned: 0 in 1.372s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:51 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762 is being set with open permissions: ugo+rw
Jul 06 15:33:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:51 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:51 devstack sudo[95767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762
Jul 06 15:33:51 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:52 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762" returned: 0 in 1.029s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:53 devstack sudo[95774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.info
Jul 06 15:33:53 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:54 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.info" returned: 0 in 1.416s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:54 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.info is being set with open permissions: ugo+rw
Jul 06 15:33:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:54 devstack sudo[95790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.info
Jul 06 15:33:54 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:55 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.info" returned: 0 in 1.357s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.202s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:33:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-94be0bbd-fd2a-4909-a1ad-a3b8a1e2aa76 req-45d91fa3-4095-4d4f-91a0-f31c4780e400 tempest-VolumesSnapshotsTestJSON-897913868 None] Create snapshot completed successfully
Jul 06 15:33:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Acquiring lock "cinder-2ffcf376-67e6-4044-9f4c-492f59fa0762-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:33:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "cinder-2ffcf376-67e6-4044-9f4c-492f59fa0762-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:33:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Acquiring lock "cinder-quobyte-bab55495-49a1-45eb-a406-268e062d895f" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:33:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "cinder-quobyte-bab55495-49a1-45eb-a406-268e062d895f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:33:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Acquiring lock "cinder-quobyte-2ffcf376-67e6-4044-9f4c-492f59fa0762" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:33:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "cinder-quobyte-2ffcf376-67e6-4044-9f4c-492f59fa0762" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:33:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Deleting offline snapshot 2ffcf376-67e6-4044-9f4c-492f59fa0762 of volume bab55495-49a1-45eb-a406-268e062d895f {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:33:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] snapshot_file for this snap is: volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:33:56 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[217159e5-4b97-46d0-979f-f243e62ad179]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:57 devstack sudo[95796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762
Jul 06 15:33:57 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:33:58 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root
Jul 06 15:33:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762" returned: 0 in 1.286s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:33:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bab55495-49a1-45eb-a406-268e062d895f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:33:58 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b47f07-0f4b-4a7b-83d6-d9c50365857f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:33:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:33:58 devstack sudo[95805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f
Jul 06 15:33:58 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:00 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f" returned: 0 in 1.741s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:00 devstack sudo[95834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762
Jul 06 15:34:00 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:02 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762" returned: 0 in 1.970s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:02 devstack sudo[95881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762
Jul 06 15:34:02 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:03 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f.2ffcf376-67e6-4044-9f4c-492f59fa0762" returned: 0 in 1.561s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "cinder-quobyte-2ffcf376-67e6-4044-9f4c-492f59fa0762" released by "_delete_snapshot" :: held 6.770s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "cinder-quobyte-bab55495-49a1-45eb-a406-268e062d895f" released by "delete_snapshot" :: held 6.842s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:03 devstack cinder-volume[86249]: DEBUG cinder.quota [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Created reservations ['36868c86-ac49-416b-821d-6fadc864cca7', '331dda9e-fabc-4b13-b888-3ccccf018895', '6968793b-0738-40fb-857f-70b37c9b9e40', 'e4454017-28d8-4e35-8c28-c9275febd249'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:03 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Delete snapshot completed successfully.
Jul 06 15:34:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-2d0c7e73-9ec0-4216-bdfc-d1740a704769 req-fa0496ea-4de2-4d3d-90d2-c230450ee5a1 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "cinder-2ffcf376-67e6-4044-9f4c-492f59fa0762-delete_snapshot" released by "delete_snapshot" :: held 7.160s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-727e116c-4540-4b36-852b-5d2d079731e2 req-745e62e0-f197-4ced-a6f1-d27d54812100 tempest-TestShelveInstance-150764035 None] Terminate volume connection completed successfully.
Jul 06 15:34:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-727e116c-4540-4b36-852b-5d2d079731e2 req-745e62e0-f197-4ced-a6f1-d27d54812100 tempest-TestShelveInstance-150764035 None] Deleting attachment ffbe1f44-0e9a-4f6f-b7c4-22ffddf90086. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:34:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Acquiring lock "cinder-919a4753-70be-471a-8bed-f5019004c1fe-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Lock "cinder-919a4753-70be-471a-8bed-f5019004c1fe-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Acquiring lock "cinder-bab55495-49a1-45eb-a406-268e062d895f-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "cinder-bab55495-49a1-45eb-a406-268e062d895f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Acquiring lock "cinder-quobyte-919a4753-70be-471a-8bed-f5019004c1fe" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Acquiring lock "cinder-quobyte-bab55495-49a1-45eb-a406-268e062d895f" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Lock "cinder-quobyte-919a4753-70be-471a-8bed-f5019004c1fe" acquired by "delete_volume" :: waited 0.044s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "cinder-quobyte-bab55495-49a1-45eb-a406-268e062d895f" acquired by "delete_volume" :: waited 0.047s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:05 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58c615f-0c58-4f5d-8b50-84b0c2e0f164]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:05 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e704688f-5446-46fa-ad4c-3cd81b60d4bc]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:05 devstack sudo[95888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:34:05 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:05 devstack sudo[95889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f
Jul 06 15:34:05 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:34:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:06 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 0 in 1.578s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:06 devstack sudo[96003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:06 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:07 devstack sudo[96005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:34:07 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:07 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f" returned: 0 in 2.263s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:07 devstack sudo[96014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f
Jul 06 15:34:07 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:08 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.559s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:08 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:08 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:34:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:34:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:34:08 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 1 in 1.880s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:34:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:08 devstack sudo[96022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe
Jul 06 15:34:08 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:08 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-bab55495-49a1-45eb-a406-268e062d895f" returned: 0 in 1.427s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "cinder-quobyte-bab55495-49a1-45eb-a406-268e062d895f" released by "delete_volume" :: held 3.830s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:09 devstack cinder-volume[86249]: DEBUG cinder.quota [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Created reservations ['7e6085b5-d312-4ce0-b4c7-4c817fef4bdc', 'aa51f9f9-cc7c-4c25-9e53-8c1830868633', '35796b06-4f77-4be6-930d-78e614cc030a', 'ddeb0b89-cb6f-4579-9284-837da15b0490'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:09 devstack sudo[96025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:09 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:09 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-919a4753-70be-471a-8bed-f5019004c1fe" returned: 0 in 1.348s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Lock "cinder-quobyte-919a4753-70be-471a-8bed-f5019004c1fe" released by "delete_volume" :: held 4.929s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:10 devstack cinder-volume[86249]: DEBUG cinder.quota [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Created reservations ['e4dfc13d-65e9-4fe2-a692-fd43843811fe', '71e4761e-39e5-4efc-8dc7-c98969bc2980', 'd9171195-84e4-4db9-97d4-eff05da959d7', '335648b2-ef07-44f0-9213-5255d4793fe2'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:10 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.076s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:10 devstack cinder-volume[86249]: DEBUG cinder.manager [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:10 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Deleted volume successfully.
Jul 06 15:34:10 devstack sudo[96032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:10 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:10 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-b7df33fd-832c-4b7c-8edd-8c95efb80d86 req-356b55de-2d4f-4dd5-953b-92afca2ef3f3 tempest-VolumesSnapshotsTestJSON-897913868 None] Lock "cinder-bab55495-49a1-45eb-a406-268e062d895f-delete_volume" released by "delete_volume" :: held 5.366s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:11 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.976s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:11 devstack cinder-volume[86249]: DEBUG cinder.manager [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Deleted volume successfully.
Jul 06 15:34:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [req-727e116c-4540-4b36-852b-5d2d079731e2 req-cb065fab-4198-4c4c-a712-fed8f961a9c7 tempest-TestShelveInstance-150764035 None] Lock "cinder-919a4753-70be-471a-8bed-f5019004c1fe-delete_volume" released by "delete_volume" :: held 6.367s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-715a3bc3-bc03-4f58-8c39-0e943e0b8a47 tempest-BackendsCapabilitiesAdminTestsJSON-1681293775 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86249) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 06 15:34:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-348ae911-98b6-4736-9a83-5f7f23a65990 tempest-BackendsCapabilitiesAdminTestsJSON-1681293775 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86249) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 06 15:34:20 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=2,cinder:UPDATE=20 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:34:21 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=17,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Flow 'volume_create_manager' (72ba05a2-8467-455e-94fa-00802bf85f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cd0d6b-a769-44d8-b2b8-93cb58bad61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cd0d6b-a769-44d8-b2b8-93cb58bad61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-856794046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d037d9d3-8453-44d7-b45f-fe915c136d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f548b72d63204161a1e930f526e8a73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:22Z,use_quota=True,user_id='e24f38be1bf04106aa8d5cc3a300e24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c3b253-6e2b-4448-a32c-d64e2f07b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c3b253-6e2b-4448-a32c-d64e2f07b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d75afd-fea0-46a7-9f78-13140c31a0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d75afd-fea0-46a7-9f78-13140c31a0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd037d9d3-8453-44d7-b45f-fe915c136d90', 'volume_name': 'volume-d037d9d3-8453-44d7-b45f-fe915c136d90', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a61977f-0548-4f89-8bfb-ccfeaac1f75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a61977f-0548-4f89-8bfb-ccfeaac1f75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e22422d-9548-4bdc-8619-b0cf5d262e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:22 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Volume d037d9d3-8453-44d7-b45f-fe915c136d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d037d9d3-8453-44d7-b45f-fe915c136d90', 'volume_size': 1}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-856794046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d037d9d3-8453-44d7-b45f-fe915c136d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f548b72d63204161a1e930f526e8a73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:22Z,use_quota=True,user_id='e24f38be1bf04106aa8d5cc3a300e24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Creating volume d037d9d3-8453-44d7-b45f-fe915c136d90 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:34:22 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:34:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:22 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90 1073741824
Jul 06 15:34:22 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Flow 'volume_create_manager' (790a4b2d-14ba-43c5-9b20-35a0ad453ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49514251-7a4f-4337-b310-0a647c8cea62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49514251-7a4f-4337-b310-0a647c8cea62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-342308960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3069eb5b-b9ba-41c8-9a7f-e835994adb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f548b72d63204161a1e930f526e8a73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:23Z,use_quota=True,user_id='e24f38be1bf04106aa8d5cc3a300e24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fcdfcd-5a62-4f9c-8c65-0c2f5351c990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fcdfcd-5a62-4f9c-8c65-0c2f5351c990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b7f48d-573b-41d4-954b-286850d01d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b7f48d-573b-41d4-954b-286850d01d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3069eb5b-b9ba-41c8-9a7f-e835994adb40', 'volume_name': 'volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040c44cc-7ee0-4043-840e-4add15efe7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040c44cc-7ee0-4043-840e-4add15efe7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80e0eb6-61b7-43cd-be46-147d93b96dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:23 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Volume 3069eb5b-b9ba-41c8-9a7f-e835994adb40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40', 'volume_size': 1}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Flow 'volume_create_manager' (1722e2e7-3c7d-47c4-87a5-ceafd54b0bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f8886f-1f92-40fa-b315-43077b016772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f8886f-1f92-40fa-b315-43077b016772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1664874936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82666cb-220f-49e3-81aa-b1de0564fbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f548b72d63204161a1e930f526e8a73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:24Z,use_quota=True,user_id='e24f38be1bf04106aa8d5cc3a300e24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0871dab-97c2-4f8c-a183-77f034a0d41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0871dab-97c2-4f8c-a183-77f034a0d41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d0deb3-c840-4c60-99a7-43f385a66ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d0deb3-c840-4c60-99a7-43f385a66ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e82666cb-220f-49e3-81aa-b1de0564fbc0', 'volume_name': 'volume-e82666cb-220f-49e3-81aa-b1de0564fbc0', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0110b3e-52e5-4e2f-bfd7-221dad07eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0110b3e-52e5-4e2f-bfd7-221dad07eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad37f30-6e7e-4499-a88e-a07fe17cd6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:23 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Volume e82666cb-220f-49e3-81aa-b1de0564fbc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e82666cb-220f-49e3-81aa-b1de0564fbc0', 'volume_size': 1}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-9cbb1078-471a-4e34-b951-892908271fe0 req-2d22fffe-b8dc-4845-ad70-4fa8a6514c42 tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:23 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Flow 'volume_create_manager' (92591ce5-f9c8-4690-bb64-1c1af21bbc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:24 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69b8cd8-d37a-4918-b732-0875ed619b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90 1073741824" returned: 0 in 1.365s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69b8cd8-d37a-4918-b732-0875ed619b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1403674866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4bac7b-32a4-4e32-a091-5c1c3116b37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f548b72d63204161a1e930f526e8a73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:24Z,use_quota=True,user_id='e24f38be1bf04106aa8d5cc3a300e24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af395dfd-46f6-4654-bb7e-9da9b73d9268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af395dfd-46f6-4654-bb7e-9da9b73d9268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55275431-54bc-41a4-bfa5-8eabe80e066b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55275431-54bc-41a4-bfa5-8eabe80e066b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4bac7b-32a4-4e32-a091-5c1c3116b37b', 'volume_name': 'volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7419807-94d8-4b8a-9ecc-f961bb25e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7419807-94d8-4b8a-9ecc-f961bb25e64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc543b16-9770-4ebf-80fc-fd78d6fbe73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:24 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Volume 0c4bac7b-32a4-4e32-a091-5c1c3116b37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b', 'volume_size': 1}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:24 devstack sudo[96090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90
Jul 06 15:34:24 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Flow 'volume_create_manager' (7d0aad6b-3fdf-49de-ab66-28eb0bea7a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7407d64-7d6d-4d7f-a89c-7b14f62fbf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7407d64-7d6d-4d7f-a89c-7b14f62fbf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1840765572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269c73d6-9949-47e1-bb8f-bce25343e8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f548b72d63204161a1e930f526e8a73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:25Z,use_quota=True,user_id='e24f38be1bf04106aa8d5cc3a300e24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcc8de6-0449-4175-bc5f-1d42a25c67c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcc8de6-0449-4175-bc5f-1d42a25c67c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcc7264-59c2-4345-a6cd-6ff01fa12432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcc7264-59c2-4345-a6cd-6ff01fa12432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269c73d6-9949-47e1-bb8f-bce25343e8b8', 'volume_name': 'volume-269c73d6-9949-47e1-bb8f-bce25343e8b8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65f1c2e-30fe-4d81-a692-5b07c987fc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65f1c2e-30fe-4d81-a692-5b07c987fc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b74a073-dcca-4737-b098-369a1c30cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:24 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Volume 269c73d6-9949-47e1-bb8f-bce25343e8b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269c73d6-9949-47e1-bb8f-bce25343e8b8', 'volume_size': 1}
Jul 06 15:34:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:25 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90" returned: 0 in 0.900s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] <== create_volume: return (2415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.419s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.986s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-342308960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3069eb5b-b9ba-41c8-9a7f-e835994adb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f548b72d63204161a1e930f526e8a73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:23Z,use_quota=True,user_id='e24f38be1bf04106aa8d5cc3a300e24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Creating volume 3069eb5b-b9ba-41c8-9a7f-e835994adb40 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:34:25 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:25 devstack sudo[96093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40 1073741824
Jul 06 15:34:25 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e22422d-9548-4bdc-8619-b0cf5d262e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d037d9d3-8453-44d7-b45f-fe915c136d90', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b3aac1-2bf6-4903-b2f7-7aa2ede7042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:25 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Volume volume-d037d9d3-8453-44d7-b45f-fe915c136d90 (d037d9d3-8453-44d7-b45f-fe915c136d90): created successfully
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b3aac1-2bf6-4903-b2f7-7aa2ede7042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Flow 'volume_create_manager' (72ba05a2-8467-455e-94fa-00802bf85f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:25 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-efdc0239-0e03-4114-a66b-cdbdd71823a9 tempest-CreateVolumesFromImageTest-293417963 None] Created volume successfully.
Jul 06 15:34:26 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40 1073741824" returned: 0 in 0.983s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:26 devstack sudo[96099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40
Jul 06 15:34:26 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:26 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40" returned: 0 in 0.694s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.173s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1664874936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82666cb-220f-49e3-81aa-b1de0564fbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f548b72d63204161a1e930f526e8a73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:24Z,use_quota=True,user_id='e24f38be1bf04106aa8d5cc3a300e24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Creating volume e82666cb-220f-49e3-81aa-b1de0564fbc0 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:34:26 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:26 devstack sudo[96102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0 1073741824
Jul 06 15:34:26 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80e0eb6-61b7-43cd-be46-147d93b96dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bf9a1a-e3e7-4d80-ba51-aeeeeed4e62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:26 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Volume volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40 (3069eb5b-b9ba-41c8-9a7f-e835994adb40): created successfully
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bf9a1a-e3e7-4d80-ba51-aeeeeed4e62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Flow 'volume_create_manager' (790a4b2d-14ba-43c5-9b20-35a0ad453ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e492ca79-ec1c-4c42-b442-7d3c6b475270 tempest-CreateVolumesFromImageTest-293417963 None] Created volume successfully.
Jul 06 15:34:27 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0 1073741824" returned: 0 in 0.932s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:27 devstack sudo[96108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0
Jul 06 15:34:27 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:28 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0" returned: 0 in 0.730s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:34:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-9cbb1078-471a-4e34-b951-892908271fe0 req-2d22fffe-b8dc-4845-ad70-4fa8a6514c42 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.729s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad37f30-6e7e-4499-a88e-a07fe17cd6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e82666cb-220f-49e3-81aa-b1de0564fbc0', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977c651d-7391-422c-ad10-b01017b23505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:28 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a1391c-fb94-4709-b8f5-c15265eb4ebe]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-9cbb1078-471a-4e34-b951-892908271fe0 req-2d22fffe-b8dc-4845-ad70-4fa8a6514c42 tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:28 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Volume volume-e82666cb-220f-49e3-81aa-b1de0564fbc0 (e82666cb-220f-49e3-81aa-b1de0564fbc0): created successfully
Jul 06 15:34:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977c651d-7391-422c-ad10-b01017b23505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Flow 'volume_create_manager' (1722e2e7-3c7d-47c4-87a5-ceafd54b0bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:28 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-20f3b139-cbf4-4fd9-a8a5-d401a5a6e5a9 tempest-CreateVolumesFromImageTest-293417963 None] Created volume successfully.
Jul 06 15:34:28 devstack sudo[96113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1
Jul 06 15:34:28 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:29 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-9cbb1078-471a-4e34-b951-892908271fe0 req-2d22fffe-b8dc-4845-ad70-4fa8a6514c42 tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1" returned: 0 in 0.848s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-9cbb1078-471a-4e34-b951-892908271fe0 req-2d22fffe-b8dc-4845-ad70-4fa8a6514c42 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.890s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.384s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1403674866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4bac7b-32a4-4e32-a091-5c1c3116b37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f548b72d63204161a1e930f526e8a73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:24Z,use_quota=True,user_id='e24f38be1bf04106aa8d5cc3a300e24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Creating volume 0c4bac7b-32a4-4e32-a091-5c1c3116b37b {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:34:29 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:29 devstack sudo[96118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b 1073741824
Jul 06 15:34:29 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-9cbb1078-471a-4e34-b951-892908271fe0 req-2d22fffe-b8dc-4845-ad70-4fa8a6514c42 tempest-TestInstancesWithCinderVolumes-225716769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-803168e3-3abe-4a83-851d-1ed31ed974a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2e3b555-7e04-4189-86ef-91500cc622f4', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:34:29 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-9cbb1078-471a-4e34-b951-892908271fe0 req-2d22fffe-b8dc-4845-ad70-4fa8a6514c42 tempest-TestInstancesWithCinderVolumes-225716769 None] attachment_update completed successfully.
Jul 06 15:34:30 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b 1073741824" returned: 0 in 1.063s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:30 devstack sudo[96150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b
Jul 06 15:34:30 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:31 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b" returned: 0 in 0.827s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.724s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1840765572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269c73d6-9949-47e1-bb8f-bce25343e8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f548b72d63204161a1e930f526e8a73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:25Z,use_quota=True,user_id='e24f38be1bf04106aa8d5cc3a300e24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Creating volume 269c73d6-9949-47e1-bb8f-bce25343e8b8 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:34:31 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc543b16-9770-4ebf-80fc-fd78d6fbe73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1336b6b-bd92-4134-8c28-dbef5b1350e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:31 devstack sudo[96156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8 1073741824
Jul 06 15:34:31 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Flow 'volume_create_manager' (db313f86-2adc-4676-b323-ed3e4d591afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ceca81-3031-450f-b118-049212c64b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:31 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Volume volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b (0c4bac7b-32a4-4e32-a091-5c1c3116b37b): created successfully
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1336b6b-bd92-4134-8c28-dbef5b1350e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Flow 'volume_create_manager' (92591ce5-f9c8-4690-bb64-1c1af21bbc19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ceca81-3031-450f-b118-049212c64b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1115801205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dec1542-fd75-4d96-88f2-f9fc7632a7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a6d76650d040c3a226795d3a8a186e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:31Z,use_quota=True,user_id='e934d7547e2f47a0be8e39bd6c2fb48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be115528-3181-46e0-976e-70931b996f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be115528-3181-46e0-976e-70931b996f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474576d6-151b-4766-b175-e19a27728114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474576d6-151b-4766-b175-e19a27728114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dec1542-fd75-4d96-88f2-f9fc7632a7a9', 'volume_name': 'volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d10a53-5ebd-483a-aa80-854ef98a9232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d10a53-5ebd-483a-aa80-854ef98a9232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fcf15a-43c2-4099-8030-64cedf4225ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:31 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Volume 3dec1542-fd75-4d96-88f2-f9fc7632a7a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9', 'volume_size': 1}
Jul 06 15:34:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-87b7d4a4-f0e4-46b6-82aa-596a2921fb9c tempest-CreateVolumesFromImageTest-293417963 None] Created volume successfully.
Jul 06 15:34:32 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8 1073741824" returned: 0 in 0.876s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:32 devstack sudo[96165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8
Jul 06 15:34:32 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:33 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8" returned: 0 in 0.645s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.411s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1115801205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dec1542-fd75-4d96-88f2-f9fc7632a7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a6d76650d040c3a226795d3a8a186e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:31Z,use_quota=True,user_id='e934d7547e2f47a0be8e39bd6c2fb48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Creating volume 3dec1542-fd75-4d96-88f2-f9fc7632a7a9 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:34:33 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:33 devstack sudo[96168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9 1073741824
Jul 06 15:34:33 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b74a073-dcca-4737-b098-369a1c30cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269c73d6-9949-47e1-bb8f-bce25343e8b8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d72567-f18a-48f4-837c-6a39f8519eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:33 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Volume volume-269c73d6-9949-47e1-bb8f-bce25343e8b8 (269c73d6-9949-47e1-bb8f-bce25343e8b8): created successfully
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d72567-f18a-48f4-837c-6a39f8519eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Flow 'volume_create_manager' (7d0aad6b-3fdf-49de-ab66-28eb0bea7a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3da09b75-4c82-4b6d-9d61-bb1e2598f76c tempest-CreateVolumesFromImageTest-293417963 None] Created volume successfully.
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "cinder-269c73d6-9949-47e1-bb8f-bce25343e8b8-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-269c73d6-9949-47e1-bb8f-bce25343e8b8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "cinder-quobyte-269c73d6-9949-47e1-bb8f-bce25343e8b8" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-quobyte-269c73d6-9949-47e1-bb8f-bce25343e8b8" acquired by "delete_volume" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcc156b-f50c-45b3-9868-d731f4ef3c9f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:33 devstack sudo[96175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8
Jul 06 15:34:33 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:34 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9 1073741824" returned: 0 in 0.994s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:34 devstack sudo[96178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9
Jul 06 15:34:34 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:34 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8" returned: 0 in 0.816s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:34 devstack sudo[96185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8
Jul 06 15:34:34 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:34 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9" returned: 0 in 0.674s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fcf15a-43c2-4099-8030-64cedf4225ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7baa0390-7c40-41ac-b378-507df2b723f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:34 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Volume volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9 (3dec1542-fd75-4d96-88f2-f9fc7632a7a9): created successfully
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7baa0390-7c40-41ac-b378-507df2b723f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Flow 'volume_create_manager' (db313f86-2adc-4676-b323-ed3e4d591afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:34 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f25dedca-3d15-47be-9bde-4416beb02c8e tempest-VolumeQuotasAdminTestJSON-1704066311 None] Created volume successfully.
Jul 06 15:34:35 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-269c73d6-9949-47e1-bb8f-bce25343e8b8" returned: 0 in 0.742s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-quobyte-269c73d6-9949-47e1-bb8f-bce25343e8b8" released by "delete_volume" :: held 1.614s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Created reservations ['13d1b3c6-b6b9-4fdd-84d7-8b312cf81d22', 'b7f8351a-a7de-4253-a0a7-de5f50af7fbb', '9a9a2666-efeb-4383-ab3c-9822eb24a8a2', '81614879-5441-422d-bc4f-b70808738af4'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:35 devstack sudo[96196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:35 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Acquiring lock "cinder-3dec1542-fd75-4d96-88f2-f9fc7632a7a9-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "cinder-3dec1542-fd75-4d96-88f2-f9fc7632a7a9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Acquiring lock "cinder-quobyte-3dec1542-fd75-4d96-88f2-f9fc7632a7a9" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "cinder-quobyte-3dec1542-fd75-4d96-88f2-f9fc7632a7a9" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4432f085-2023-4908-b647-8e30beeb037e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "cinder-0c4bac7b-32a4-4e32-a091-5c1c3116b37b-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-0c4bac7b-32a4-4e32-a091-5c1c3116b37b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "cinder-quobyte-0c4bac7b-32a4-4e32-a091-5c1c3116b37b" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:35 devstack sudo[96198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9
Jul 06 15:34:35 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-quobyte-0c4bac7b-32a4-4e32-a091-5c1c3116b37b" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[219052c4-0fc8-4744-a789-d53c082adecd]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:36 devstack sudo[96200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b
Jul 06 15:34:36 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:36 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.721s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:36 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Deleted volume successfully.
Jul 06 15:34:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-718dd005-9285-4671-b6b1-acbaad3147a0 tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-269c73d6-9949-47e1-bb8f-bce25343e8b8-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:36 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9" returned: 0 in 0.834s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:36 devstack sudo[96207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9
Jul 06 15:34:36 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:36 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b" returned: 0 in 0.877s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:36 devstack sudo[96212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b
Jul 06 15:34:36 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:37 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3dec1542-fd75-4d96-88f2-f9fc7632a7a9" returned: 0 in 0.774s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "cinder-quobyte-3dec1542-fd75-4d96-88f2-f9fc7632a7a9" released by "delete_volume" :: held 1.656s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Created reservations ['702de9c9-efa9-4439-b3b1-b5b2333b2001', '71e06b96-cb2b-4e10-9da1-196a802e111c', '7c6707e6-a4bc-460f-8bbe-f092072ecdae', '07c9fe5e-3ed4-4de3-a02e-9c1826787d77'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:37 devstack sudo[96216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:37 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:37 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c4bac7b-32a4-4e32-a091-5c1c3116b37b" returned: 0 in 0.752s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-quobyte-0c4bac7b-32a4-4e32-a091-5c1c3116b37b" released by "delete_volume" :: held 1.673s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Created reservations ['fd9ff6de-e901-4bf8-af18-aab2f959fa51', '550da357-ae3b-4451-80aa-dd42aa31de86', '76c865b9-5998-4ef7-9548-5b639b0f2c04', 'a071d6e3-ad44-46f8-bb66-7c4ce466fd47'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:37 devstack sudo[96218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:37 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-3df9cb64-705b-4e61-ba96-23216cac1cbb req-9b40867d-f43d-4b41-b566-88783cd8511b tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-3df9cb64-705b-4e61-ba96-23216cac1cbb req-9b40867d-f43d-4b41-b566-88783cd8511b tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[907a1177-93da-44d9-9951-ede4a2b50495]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-3df9cb64-705b-4e61-ba96-23216cac1cbb req-9b40867d-f43d-4b41-b566-88783cd8511b tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:38 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.749s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Deleted volume successfully.
Jul 06 15:34:38 devstack sudo[96230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb
Jul 06 15:34:38 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-aef16d48-2a12-4c9b-8afa-d04052c46b27 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "cinder-3dec1542-fd75-4d96-88f2-f9fc7632a7a9-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "cinder-e82666cb-220f-49e3-81aa-b1de0564fbc0-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-e82666cb-220f-49e3-81aa-b1de0564fbc0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "cinder-quobyte-e82666cb-220f-49e3-81aa-b1de0564fbc0" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-quobyte-e82666cb-220f-49e3-81aa-b1de0564fbc0" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[623001bc-38dd-49b2-a275-5a647f4da930]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:38 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.988s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Deleted volume successfully.
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Flow 'volume_create_manager' (dbed9d2d-b433-48e5-86db-1060224adf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d30320-ca80-4a5a-965c-108048ad2f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d30320-ca80-4a5a-965c-108048ad2f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1995088949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31af7a9a-b479-48d8-9f54-01f976b7db17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a6d76650d040c3a226795d3a8a186e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:39Z,use_quota=True,user_id='e934d7547e2f47a0be8e39bd6c2fb48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f15598-787b-4352-b06c-0b076e3d1a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f15598-787b-4352-b06c-0b076e3d1a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e206fe-5e10-42b6-9387-3ed0cd2e7a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e206fe-5e10-42b6-9387-3ed0cd2e7a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31af7a9a-b479-48d8-9f54-01f976b7db17', 'volume_name': 'volume-31af7a9a-b479-48d8-9f54-01f976b7db17', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:38 devstack sudo[96233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0
Jul 06 15:34:38 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f6f5fc-9288-411d-bd96-1ecfdb6d462c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f6f5fc-9288-411d-bd96-1ecfdb6d462c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b44407-194f-45e1-839a-c2575e219509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:38 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Volume 31af7a9a-b479-48d8-9f54-01f976b7db17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31af7a9a-b479-48d8-9f54-01f976b7db17', 'volume_size': 1}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-76433aa0-3cee-47c8-92a3-d91b3725e836 tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-0c4bac7b-32a4-4e32-a091-5c1c3116b37b-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-734c946c-a13e-40df-8fb0-5d9c6cf022f9 req-2a2d7d82-3d5b-43fe-a17f-807e1c8d4962 tempest-AttachVolumeNegativeTest-2009578222 None] Terminate volume connection completed successfully.
Jul 06 15:34:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-734c946c-a13e-40df-8fb0-5d9c6cf022f9 req-2a2d7d82-3d5b-43fe-a17f-807e1c8d4962 tempest-AttachVolumeNegativeTest-2009578222 None] Deleting attachment a8442ccd-54bf-47b4-9f1a-46b47ea28af5. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:34:39 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-3df9cb64-705b-4e61-ba96-23216cac1cbb req-9b40867d-f43d-4b41-b566-88783cd8511b tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb" returned: 0 in 0.899s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-3df9cb64-705b-4e61-ba96-23216cac1cbb req-9b40867d-f43d-4b41-b566-88783cd8511b tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.930s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.258s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1995088949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31af7a9a-b479-48d8-9f54-01f976b7db17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a6d76650d040c3a226795d3a8a186e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:39Z,use_quota=True,user_id='e934d7547e2f47a0be8e39bd6c2fb48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Creating volume 31af7a9a-b479-48d8-9f54-01f976b7db17 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:34:39 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:39 devstack sudo[96242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17 1073741824
Jul 06 15:34:39 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-3df9cb64-705b-4e61-ba96-23216cac1cbb req-9b40867d-f43d-4b41-b566-88783cd8511b tempest-TestInstancesWithCinderVolumes-225716769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1c6b15e-6f6c-4757-944e-6061149ebb03', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:34:39 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-3df9cb64-705b-4e61-ba96-23216cac1cbb req-9b40867d-f43d-4b41-b566-88783cd8511b tempest-TestInstancesWithCinderVolumes-225716769 None] attachment_update completed successfully.
Jul 06 15:34:39 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0" returned: 0 in 0.961s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:39 devstack sudo[96253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0
Jul 06 15:34:39 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:40 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17 1073741824" returned: 0 in 0.966s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:40 devstack sudo[96260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17
Jul 06 15:34:40 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:40 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-e82666cb-220f-49e3-81aa-b1de0564fbc0" returned: 0 in 0.708s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-quobyte-e82666cb-220f-49e3-81aa-b1de0564fbc0" released by "delete_volume" :: held 1.753s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Created reservations ['40aa2962-04c5-4467-8a53-1a104729ffd1', '7144f364-f63f-4eb5-9bda-39f4e75aeb68', '85ad6fa6-179b-4a7b-9c2f-2f50f0b24e10', 'b71e9e49-2c56-4a2e-b4d5-5db584293d20'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:40 devstack sudo[96265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:40 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "cinder-3069eb5b-b9ba-41c8-9a7f-e835994adb40-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-3069eb5b-b9ba-41c8-9a7f-e835994adb40-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "cinder-quobyte-3069eb5b-b9ba-41c8-9a7f-e835994adb40" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-quobyte-3069eb5b-b9ba-41c8-9a7f-e835994adb40" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f5e2df-6013-42ca-a287-a9d544bc63bc]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:40 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17" returned: 0 in 0.827s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b44407-194f-45e1-839a-c2575e219509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31af7a9a-b479-48d8-9f54-01f976b7db17', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389fd99e-15c5-4e49-90e8-07e7d6f744a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:40 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Volume volume-31af7a9a-b479-48d8-9f54-01f976b7db17 (31af7a9a-b479-48d8-9f54-01f976b7db17): created successfully
Jul 06 15:34:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389fd99e-15c5-4e49-90e8-07e7d6f744a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:40 devstack sudo[96268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40
Jul 06 15:34:40 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Flow 'volume_create_manager' (dbed9d2d-b433-48e5-86db-1060224adf32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:41 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5a3d7b3f-eb12-491b-aa41-337aaad684b2 tempest-VolumeQuotasAdminTestJSON-1704066311 None] Created volume successfully.
Jul 06 15:34:41 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.775s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:41 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:41 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Deleted volume successfully.
Jul 06 15:34:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1093f92-3558-42a0-a0f3-7fb413d5df9c tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-e82666cb-220f-49e3-81aa-b1de0564fbc0-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:41 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40" returned: 0 in 0.835s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:41 devstack sudo[96274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40
Jul 06 15:34:41 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:42 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3069eb5b-b9ba-41c8-9a7f-e835994adb40" returned: 0 in 0.664s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-quobyte-3069eb5b-b9ba-41c8-9a7f-e835994adb40" released by "delete_volume" :: held 1.565s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:42 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-eedfb64a-be01-411a-a529-ad3c28c51684 tempest-VolumeQuotasAdminTestJSON-147606078 None] Transfer volume completed successfully.
Jul 06 15:34:42 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Created reservations ['09a6ba8e-93f8-4c69-844e-724ecd23ca91', '02453741-ced1-41e6-b704-1fa4cf986251', '7455ba76-9511-498d-8310-8c1868f98660', 'f6f0494c-f0f3-4b75-8ef6-e4f50b1f69de'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:42 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:42 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:42 devstack sudo[96283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:42 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "cinder-d037d9d3-8453-44d7-b45f-fe915c136d90-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-d037d9d3-8453-44d7-b45f-fe915c136d90-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "cinder-quobyte-d037d9d3-8453-44d7-b45f-fe915c136d90" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-quobyte-d037d9d3-8453-44d7-b45f-fe915c136d90" acquired by "delete_volume" :: waited 0.039s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e74306-778e-457c-8722-d2535183594c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:43 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.075s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Deleted volume successfully.
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ef1a8ed8-3497-41b8-a515-bcbfb8ac4cfe tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-3069eb5b-b9ba-41c8-9a7f-e835994adb40-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:43 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90
Jul 06 15:34:43 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Acquiring lock "cinder-31af7a9a-b479-48d8-9f54-01f976b7db17-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Lock "cinder-31af7a9a-b479-48d8-9f54-01f976b7db17-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Acquiring lock "cinder-quobyte-31af7a9a-b479-48d8-9f54-01f976b7db17" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Lock "cinder-quobyte-31af7a9a-b479-48d8-9f54-01f976b7db17" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:44 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[72beb446-bb60-4c27-9f03-c403668daada]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:44 devstack sudo[96305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17
Jul 06 15:34:44 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:44 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90" returned: 0 in 1.089s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:44 devstack sudo[96317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90
Jul 06 15:34:44 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:45 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17" returned: 0 in 1.081s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:45 devstack sudo[96325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17
Jul 06 15:34:45 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:45 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d037d9d3-8453-44d7-b45f-fe915c136d90" returned: 0 in 0.846s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-quobyte-d037d9d3-8453-44d7-b45f-fe915c136d90" released by "delete_volume" :: held 2.025s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Created reservations ['6962f874-4db4-4104-be6a-63934e1b0f37', '5566180b-5b11-4808-bcd6-3238cd42f4f4', 'bdae1110-2d17-48a6-bdc3-ef3e08529d9a', '4e936b8e-1b9f-4793-8d76-1bb99436ca12'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:45 devstack sudo[96328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:45 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:45 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-31af7a9a-b479-48d8-9f54-01f976b7db17" returned: 0 in 0.739s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Lock "cinder-quobyte-31af7a9a-b479-48d8-9f54-01f976b7db17" released by "delete_volume" :: held 1.884s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:45 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Created reservations ['c0fc72a0-51a6-433e-ab2d-4c1f8863585f', '5c2b2c55-6c23-4ee1-b502-d69d7ce1776b', 'a51385af-dd8b-44f4-91b3-d9078b244a8e', '0f9dad07-40fa-4b08-a421-3187ae541420'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:46 devstack sudo[96331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:46 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:46 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.847s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Deleted volume successfully.
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd89f028-6d2f-4e5f-8106-e22d957a870d tempest-CreateVolumesFromImageTest-293417963 None] Lock "cinder-d037d9d3-8453-44d7-b45f-fe915c136d90-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:46 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.878s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Deleted volume successfully.
Jul 06 15:34:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b0c58441-78a2-4f07-b348-d48010c974c7 tempest-VolumeQuotasAdminTestJSON-1477520259 None] Lock "cinder-31af7a9a-b479-48d8-9f54-01f976b7db17-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (2280352d-1156-4fc3-b1f0-05f7116de3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08652502-e2e6-4c46-9bb2-5cde521dbc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08652502-e2e6-4c46-9bb2-5cde521dbc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2095749236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b05b681-2eb9-4310-8e15-413bbdd2eccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:50Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02e27c2-586e-460d-b1d9-bdd1fabf5716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02e27c2-586e-460d-b1d9-bdd1fabf5716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15cf5fa-fcdb-4e07-a787-6cae2e616676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15cf5fa-fcdb-4e07-a787-6cae2e616676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b05b681-2eb9-4310-8e15-413bbdd2eccf', 'volume_name': 'volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcad0a5-d364-4650-ab3b-5a4186a65a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcad0a5-d364-4650-ab3b-5a4186a65a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f99e2a0-7f4a-422f-8dc0-fcd501dd2e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:49 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume 8b05b681-2eb9-4310-8e15-413bbdd2eccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf', 'volume_size': 1}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2095749236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b05b681-2eb9-4310-8e15-413bbdd2eccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:50Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Creating volume 8b05b681-2eb9-4310-8e15-413bbdd2eccf {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:34:49 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:34:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:49 devstack sudo[96358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf 1073741824
Jul 06 15:34:49 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:50 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-6d607960-9953-4330-82ad-9f966ea2ca4b req-f9164007-b97a-42c1-944f-82108d90ac53 tempest-TestInstancesWithCinderVolumes-225716769 None] Terminate volume connection completed successfully.
Jul 06 15:34:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-6d607960-9953-4330-82ad-9f966ea2ca4b req-f9164007-b97a-42c1-944f-82108d90ac53 tempest-TestInstancesWithCinderVolumes-225716769 None] Deleting attachment b2e3b555-7e04-4189-86ef-91500cc622f4. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:34:50 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf 1073741824" returned: 0 in 1.090s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:50 devstack sudo[96367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf
Jul 06 15:34:50 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:51 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf" returned: 0 in 0.777s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:34:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f99e2a0-7f4a-422f-8dc0-fcd501dd2e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d623a1fe-f30e-4aee-946d-42b91a490736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:34:51 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf (8b05b681-2eb9-4310-8e15-413bbdd2eccf): created successfully
Jul 06 15:34:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d623a1fe-f30e-4aee-946d-42b91a490736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:34:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (2280352d-1156-4fc3-b1f0-05f7116de3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:34:51 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9936ab43-27bd-45f3-92ff-da283e30405a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created volume successfully.
Jul 06 15:34:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "cinder-803168e3-3abe-4a83-851d-1ed31ed974a1-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-803168e3-3abe-4a83-851d-1ed31ed974a1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "cinder-quobyte-803168e3-3abe-4a83-851d-1ed31ed974a1" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-quobyte-803168e3-3abe-4a83-851d-1ed31ed974a1" acquired by "delete_volume" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:52 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ce7092-038e-4389-87b5-17568e064c27]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:52 devstack sudo[96374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1
Jul 06 15:34:52 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Creating offline snapshot c7784091-e76c-48f5-9d78-8698fcf1147c of volume 8b05b681-2eb9-4310-8e15-413bbdd2eccf {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:34:53 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a8456a-bd46-4764-8593-0efbbc7ad506]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:53 devstack sudo[96380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf
Jul 06 15:34:53 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:53 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1" returned: 0 in 1.067s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:53 devstack sudo[96382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1
Jul 06 15:34:53 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:54 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf" returned: 0 in 1.116s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:54 devstack sudo[96391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c 1G
Jul 06 15:34:54 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:54 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-803168e3-3abe-4a83-851d-1ed31ed974a1" returned: 0 in 1.035s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-quobyte-803168e3-3abe-4a83-851d-1ed31ed974a1" released by "delete_volume" :: held 2.160s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:54 devstack cinder-volume[86249]: WARNING cinder.quota [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-541247611-260964334 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-541247611-260964334, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:34:54 devstack cinder-volume[86249]: WARNING cinder.quota [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-541247611-260964334 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-541247611-260964334, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Created reservations ['55b69221-0545-46a3-93e9-5398f9a22f7a', 'da0e41d2-8bb8-4cbe-962e-92b51ee775a9', '375ccd7a-256e-443e-8337-888d2ecc3beb', 'c1e3bf59-b54b-48d3-a5e4-5e6848038f0d'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:54 devstack sudo[96395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:34:54 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:55 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.791s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:55 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:34:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Deleted volume successfully.
Jul 06 15:34:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-266e23c1-1764-464d-bce3-33590fd18688 tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-803168e3-3abe-4a83-851d-1ed31ed974a1-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:34:55 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c 1G" returned: 0 in 1.203s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:55 devstack sudo[96415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c
Jul 06 15:34:55 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:56 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c" returned: 0 in 0.829s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:56 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c is being set with open permissions: ugo+rw
Jul 06 15:34:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:56 devstack sudo[96424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c
Jul 06 15:34:56 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:56 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c" returned: 0 in 0.711s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:57 devstack sudo[96428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.info
Jul 06 15:34:57 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:57 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-3c77bbdd-4b6a-46e0-8b6f-5439b873fe71 req-fbf8d359-da68-4cff-b491-aa649976a22b tempest-TestInstancesWithCinderVolumes-225716769 None] Terminate volume connection completed successfully.
Jul 06 15:34:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-3c77bbdd-4b6a-46e0-8b6f-5439b873fe71 req-fbf8d359-da68-4cff-b491-aa649976a22b tempest-TestInstancesWithCinderVolumes-225716769 None] Deleting attachment a1c6b15e-6f6c-4757-944e-6061149ebb03. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:34:57 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.info" returned: 0 in 0.862s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:57 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.info is being set with open permissions: ugo+rw
Jul 06 15:34:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:57 devstack sudo[96433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.info
Jul 06 15:34:57 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:34:58 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root
Jul 06 15:34:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.info" returned: 0 in 0.736s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:34:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.571s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:34:58 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8dd036cd-4154-4b4e-823f-65b217430467 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Create snapshot completed successfully
Jul 06 15:34:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "cinder-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "cinder-quobyte-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:34:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-quobyte-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:34:59 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba851475-0535-45b8-8bf0-8d8e0813b2e5]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:34:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:34:59 devstack sudo[96436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb
Jul 06 15:34:59 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (f470be82-8d7e-48e1-ba08-996065882247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e76f2e-f596-4de4-afde-176603520ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e76f2e-f596-4de4-afde-176603520ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-929941164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:00Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc3a15b-b468-45b9-98f4-3e16b661fabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc3a15b-b468-45b9-98f4-3e16b661fabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2147bf-ad98-4fe1-bee7-4113f81b23f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2147bf-ad98-4fe1-bee7-4113f81b23f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8', 'volume_name': 'volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bfddb6-cc3f-4588-84af-ac0393ab6d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bfddb6-cc3f-4588-84af-ac0393ab6d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460b9625-138a-41fd-901c-e9ec421d9daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:00 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume 0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8', 'volume_size': 1}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-929941164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:00Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Creating volume 0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:35:00 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:00 devstack sudo[96439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8 1073741824
Jul 06 15:35:00 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (f81665b4-6f5e-4bd5-b4e3-73e3b56c8527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ea4d15-abf3-4be6-87df-598c78b145f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:00 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ea4d15-abf3-4be6-87df-598c78b145f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58122718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcf1afe-4ed8-42f4-a587-bd92d32e140e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:01Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d0620d-1b81-463b-9f27-2f189d37261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d0620d-1b81-463b-9f27-2f189d37261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c070732-9a95-452f-8e92-c4a6a4c3cbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c070732-9a95-452f-8e92-c4a6a4c3cbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fcf1afe-4ed8-42f4-a587-bd92d32e140e', 'volume_name': 'volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee85bc57-aeb1-4029-9d04-cf5e46822078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee85bc57-aeb1-4029-9d04-cf5e46822078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb3c4d1-053b-4b90-8d12-5b5a4432fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:01 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume 5fcf1afe-4ed8-42f4-a587-bd92d32e140e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e', 'volume_size': 1}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb" returned: 0 in 1.557s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:01 devstack sudo[96444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb
Jul 06 15:35:01 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (e57eb92f-253b-4bfd-a242-61a318b74caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dc6846-e439-4e75-9ad5-328ceed6d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dc6846-e439-4e75-9ad5-328ceed6d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543752355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353d09e2-e989-410c-995b-9e1024bb7b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:01Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485f81c4-da29-4342-9134-0dbb5c217a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485f81c4-da29-4342-9134-0dbb5c217a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920c19b-7980-490e-a000-0c7753968e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920c19b-7980-490e-a000-0c7753968e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353d09e2-e989-410c-995b-9e1024bb7b52', 'volume_name': 'volume-353d09e2-e989-410c-995b-9e1024bb7b52', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279848db-af53-4961-9b9f-4916fdd2438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279848db-af53-4961-9b9f-4916fdd2438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197b1567-ed2b-42a4-b705-e0acd5953291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:01 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume 353d09e2-e989-410c-995b-9e1024bb7b52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353d09e2-e989-410c-995b-9e1024bb7b52', 'volume_size': 1}
Jul 06 15:35:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (3f45d8a5-1cc8-4caf-8bbf-9e615b1f508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec12e17-146b-40a9-8ef3-3c183c05acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec12e17-146b-40a9-8ef3-3c183c05acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-371507492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0678faaf-76cd-4091-a21c-32125fd2fe3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:02Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e18f0a2-d9d2-4b64-9f30-d8186bae4d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e18f0a2-d9d2-4b64-9f30-d8186bae4d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6d66c9-28ed-4eb7-ad92-90a25188ec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6d66c9-28ed-4eb7-ad92-90a25188ec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0678faaf-76cd-4091-a21c-32125fd2fe3a', 'volume_name': 'volume-0678faaf-76cd-4091-a21c-32125fd2fe3a', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958ab3ef-4594-4a22-a5af-6f57af21b95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958ab3ef-4594-4a22-a5af-6f57af21b95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9898c33c-b64d-46f7-93cc-3f2f6bfb214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:02 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume 0678faaf-76cd-4091-a21c-32125fd2fe3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0678faaf-76cd-4091-a21c-32125fd2fe3a', 'volume_size': 1}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:02 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8 1073741824" returned: 0 in 2.227s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:02 devstack sudo[96467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8
Jul 06 15:35:02 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:03 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb" returned: 0 in 1.994s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-quobyte-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb" released by "delete_volume" :: held 3.644s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:03 devstack cinder-volume[86249]: WARNING cinder.quota [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-720765087-1450741604 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-720765087-1450741604, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:35:03 devstack cinder-volume[86249]: WARNING cinder.quota [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-720765087-1450741604 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-720765087-1450741604, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Created reservations ['cd7f5585-b462-470b-9558-fcba3a6797db', '6ef5ea8d-8317-42a2-ad44-3c1a820ba067', 'c6a6440c-90d1-4d5e-90b7-cdd3b48939da', '8a2917c1-6ca7-4e4e-a500-62e7f23cc480'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (977de54d-0e1a-4933-9cf9-4e01377614cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84eff41-6e14-4750-b258-23486675db63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84eff41-6e14-4750-b258-23486675db63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1382332585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c211411-767e-492e-a922-fca26ce634c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:03Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ab54dc-f6e9-4efa-91b1-283ccd47eb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:03 devstack sudo[96471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ab54dc-f6e9-4efa-91b1-283ccd47eb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:03 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2082d0f-b035-4aa7-92c5-b87d3fb6f4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2082d0f-b035-4aa7-92c5-b87d3fb6f4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c211411-767e-492e-a922-fca26ce634c6', 'volume_name': 'volume-0c211411-767e-492e-a922-fca26ce634c6', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12861154-a0b3-4546-90c9-71def508d7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12861154-a0b3-4546-90c9-71def508d7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe18f706-f159-4b3e-99ce-d2d7d7e53efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:03 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume 0c211411-767e-492e-a922-fca26ce634c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c211411-767e-492e-a922-fca26ce634c6', 'volume_size': 1}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:03 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8" returned: 0 in 1.075s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] <== create_volume: return (3413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.420s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.831s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58122718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcf1afe-4ed8-42f4-a587-bd92d32e140e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:01Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Creating volume 5fcf1afe-4ed8-42f4-a587-bd92d32e140e {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:35:03 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:35:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460b9625-138a-41fd-901c-e9ec421d9daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:04 devstack sudo[96474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e 1073741824
Jul 06 15:35:04 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873a2f40-064c-4fd3-a0a2-d4d60e071b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:04 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8 (0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8): created successfully
Jul 06 15:35:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873a2f40-064c-4fd3-a0a2-d4d60e071b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (f470be82-8d7e-48e1-ba08-996065882247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-557ea7ff-7f64-44df-9637-96a4bcc2376b tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created volume successfully.
Jul 06 15:35:04 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.957s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:04 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Deleted volume successfully.
Jul 06 15:35:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b06a7656-3500-4cf2-980c-8f1d0581cd4a tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-751f7d63-a2e4-43c8-b14a-bcf19c0f4eeb-delete_volume" released by "delete_volume" :: held 5.033s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:05 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e 1073741824" returned: 0 in 1.346s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:05 devstack sudo[96483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e
Jul 06 15:35:05 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:06 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e" returned: 0 in 0.876s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.306s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.578s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543752355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353d09e2-e989-410c-995b-9e1024bb7b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:01Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Creating volume 353d09e2-e989-410c-995b-9e1024bb7b52 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:35:06 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:06 devstack sudo[96491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52 1073741824
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb3c4d1-053b-4b90-8d12-5b5a4432fec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:06 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373ff21a-cf03-43c8-b929-d648358c8776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:06 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e (5fcf1afe-4ed8-42f4-a587-bd92d32e140e): created successfully
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373ff21a-cf03-43c8-b929-d648358c8776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (f81665b4-6f5e-4bd5-b4e3-73e3b56c8527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:06 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-34bb8f25-01df-40a8-a33f-f14b8ec45c32 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created volume successfully.
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:06 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:06 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:07 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52 1073741824" returned: 0 in 1.488s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:07 devstack sudo[96553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52
Jul 06 15:35:07 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:08 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.497s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:35:08 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52" returned: 0 in 1.060s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] <== create_volume: return (2628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.630s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.433s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-371507492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0678faaf-76cd-4091-a21c-32125fd2fe3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:02Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Creating volume 0678faaf-76cd-4091-a21c-32125fd2fe3a {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:35:08 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:08 devstack sudo[96560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a 1073741824
Jul 06 15:35:08 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197b1567-ed2b-42a4-b705-e0acd5953291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353d09e2-e989-410c-995b-9e1024bb7b52', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4636c549-acc3-4c4c-8984-24d72c7b4ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:08 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume volume-353d09e2-e989-410c-995b-9e1024bb7b52 (353d09e2-e989-410c-995b-9e1024bb7b52): created successfully
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4636c549-acc3-4c4c-8984-24d72c7b4ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (e57eb92f-253b-4bfd-a242-61a318b74caf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:09 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fb927d9f-0a88-433b-91d1-cf52db389f48 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created volume successfully.
Jul 06 15:35:09 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-8ba103c6-8d6d-407a-a59f-c736582952d5 req-b3c961ae-7036-41e0-8a0d-a45e8572a984 tempest-TestInstancesWithCinderVolumes-225716769 None] Terminate volume connection completed successfully.
Jul 06 15:35:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-8ba103c6-8d6d-407a-a59f-c736582952d5 req-b3c961ae-7036-41e0-8a0d-a45e8572a984 tempest-TestInstancesWithCinderVolumes-225716769 None] Deleting attachment 0d073c3c-5a78-4efe-b9d4-9a256b67a9db. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:35:10 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a 1073741824" returned: 0 in 1.156s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:10 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a
Jul 06 15:35:10 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:10 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a" returned: 0 in 0.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.332s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1382332585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c211411-767e-492e-a922-fca26ce634c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a812512fa0654a67857794b058aecc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:03Z,use_quota=True,user_id='f189aac94a6546f29f0c5cd9bb4503a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Creating volume 0c211411-767e-492e-a922-fca26ce634c6 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:35:10 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9898c33c-b64d-46f7-93cc-3f2f6bfb214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0678faaf-76cd-4091-a21c-32125fd2fe3a', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:11 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6 1073741824
Jul 06 15:35:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5af42bc-6bfb-48a1-b985-68e4a6904744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:11 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:11 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume volume-0678faaf-76cd-4091-a21c-32125fd2fe3a (0678faaf-76cd-4091-a21c-32125fd2fe3a): created successfully
Jul 06 15:35:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5af42bc-6bfb-48a1-b985-68e4a6904744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (3f45d8a5-1cc8-4caf-8bbf-9e615b1f508b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5c9608f4-4cd3-498d-881f-439711a0ace8 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created volume successfully.
Jul 06 15:35:12 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6 1073741824" returned: 0 in 1.288s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:12 devstack sudo[96641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6
Jul 06 15:35:12 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:13 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6" returned: 0 in 0.863s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.221s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe18f706-f159-4b3e-99ce-d2d7d7e53efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c211411-767e-492e-a922-fca26ce634c6', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5319eec6-a6ef-47cc-859f-ae1e464c81fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:13 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Volume volume-0c211411-767e-492e-a922-fca26ce634c6 (0c211411-767e-492e-a922-fca26ce634c6): created successfully
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5319eec6-a6ef-47cc-859f-ae1e464c81fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Flow 'volume_create_manager' (977de54d-0e1a-4933-9cf9-4e01377614cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:13 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-16769541-7147-4299-89b8-deab61e892c6 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created volume successfully.
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-0c211411-767e-492e-a922-fca26ce634c6-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-0c211411-767e-492e-a922-fca26ce634c6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-quobyte-0c211411-767e-492e-a922-fca26ce634c6" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-0c211411-767e-492e-a922-fca26ce634c6" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[49326e4d-3798-415b-b778-9ca1f6b6829d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "cinder-a05a6e65-283a-4b5c-b8b3-5826cf28813f-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-a05a6e65-283a-4b5c-b8b3-5826cf28813f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:13 devstack sudo[96646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6
Jul 06 15:35:13 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "cinder-quobyte-a05a6e65-283a-4b5c-b8b3-5826cf28813f" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-quobyte-a05a6e65-283a-4b5c-b8b3-5826cf28813f" acquired by "delete_volume" :: waited 0.040s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:14 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c57770b-bf1f-498d-a5ab-8c08941023b2]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:14 devstack sudo[96648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f
Jul 06 15:35:14 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:14 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6" returned: 0 in 1.192s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:14 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:35:14 devstack sudo[96656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6
Jul 06 15:35:14 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Flow 'volume_create_manager' (93d2a1b5-71cd-47f6-b319-d686547232b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f767a5c-64b9-4591-8411-c3acdf3f2ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f767a5c-64b9-4591-8411-c3acdf3f2ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1897729395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7526b979-50b3-4095-bbe7-9750b975a786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68422c0c8faf4b90a9264f4ae54b4673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:15Z,use_quota=True,user_id='952b6b9fac2c44be9827f285335a500b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2337fe5-e953-477b-9bc3-d9dc80eacff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2337fe5-e953-477b-9bc3-d9dc80eacff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f45e61-e96b-47fc-971d-1386d314b085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f45e61-e96b-47fc-971d-1386d314b085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7526b979-50b3-4095-bbe7-9750b975a786', 'volume_name': 'volume-7526b979-50b3-4095-bbe7-9750b975a786', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdf61d4-3f34-4423-a33c-fd07e1eb8866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdf61d4-3f34-4423-a33c-fd07e1eb8866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6545b14e-d330-4d84-a737-158b5991c1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:15 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Volume 7526b979-50b3-4095-bbe7-9750b975a786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7526b979-50b3-4095-bbe7-9750b975a786', 'volume_size': 1}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1897729395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7526b979-50b3-4095-bbe7-9750b975a786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68422c0c8faf4b90a9264f4ae54b4673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:15Z,use_quota=True,user_id='952b6b9fac2c44be9827f285335a500b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Creating volume 7526b979-50b3-4095-bbe7-9750b975a786 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:35:15 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:15 devstack sudo[96658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786 1073741824
Jul 06 15:35:15 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:15 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f" returned: 0 in 1.123s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:15 devstack sudo[96660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f
Jul 06 15:35:15 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:15 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0c211411-767e-492e-a922-fca26ce634c6" returned: 0 in 0.979s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-0c211411-767e-492e-a922-fca26ce634c6" released by "delete_volume" :: held 2.236s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created reservations ['2c44a427-a12e-46fb-9420-80dfae76cd19', 'ea91fe89-78f5-4b91-8e03-c3feef80ddb0', '90cbd9af-7edc-4414-8b18-9b8ab6b22e45', '9557bf38-16b6-46ee-8b91-bfc615d354a8'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:16 devstack sudo[96669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:16 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:16 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f" returned: 1 in 1.114s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:16 devstack sudo[96672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f
Jul 06 15:35:16 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:16 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786 1073741824" returned: 0 in 1.386s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:16 devstack sudo[96674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786
Jul 06 15:35:16 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-0678faaf-76cd-4091-a21c-32125fd2fe3a-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-0678faaf-76cd-4091-a21c-32125fd2fe3a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-quobyte-0678faaf-76cd-4091-a21c-32125fd2fe3a" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-0678faaf-76cd-4091-a21c-32125fd2fe3a" acquired by "delete_volume" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:17 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a05a6e65-283a-4b5c-b8b3-5826cf28813f" returned: 0 in 1.142s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[66967e37-bc00-412c-8e3b-a7cf4482efa3]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-quobyte-a05a6e65-283a-4b5c-b8b3-5826cf28813f" released by "delete_volume" :: held 3.474s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:17 devstack cinder-volume[86249]: WARNING cinder.quota [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1124071730-2044124846 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1124071730-2044124846, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:35:17 devstack cinder-volume[86249]: WARNING cinder.quota [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1124071730-2044124846 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1124071730-2044124846, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Created reservations ['f115bce5-2c53-42e4-955e-a7fe232a9a58', 'a2ab6854-3a4d-4f09-9be0-09e159417a9e', '8fbf2569-728b-4b59-ab79-b157cdfab2fd', 'eb006606-1dfe-4fe0-98b5-6b057bf0025a'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:17 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.443s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:17 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Deleted volume successfully.
Jul 06 15:35:17 devstack sudo[96679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a
Jul 06 15:35:17 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c246b1cb-c33d-4e5c-a652-e0956a172b7f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-0c211411-767e-492e-a922-fca26ce634c6-delete_volume" released by "delete_volume" :: held 4.040s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:17 devstack sudo[96682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:17 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:18 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786" returned: 0 in 1.648s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] <== create_volume: return (3115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.119s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6545b14e-d330-4d84-a737-158b5991c1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7526b979-50b3-4095-bbe7-9750b975a786', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dd8b25-1794-4d84-b4fa-0a4a98d887a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:18 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Volume volume-7526b979-50b3-4095-bbe7-9750b975a786 (7526b979-50b3-4095-bbe7-9750b975a786): created successfully
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dd8b25-1794-4d84-b4fa-0a4a98d887a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Flow 'volume_create_manager' (93d2a1b5-71cd-47f6-b319-d686547232b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:18 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-09ee1ce7-91cc-4df2-95b4-b2e08d1b9f2e tempest-AbsoluteLimitsTests-1237301735 None] Created volume successfully.
Jul 06 15:35:18 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.986s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:18 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:18 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Deleted volume successfully.
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a" returned: 0 in 1.265s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c6fde2c3-f220-4311-b89a-9eccd6bbb7bf tempest-TestInstancesWithCinderVolumes-225716769 None] Lock "cinder-a05a6e65-283a-4b5c-b8b3-5826cf28813f-delete_volume" released by "delete_volume" :: held 4.949s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:18 devstack sudo[96689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a
Jul 06 15:35:18 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:19 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0678faaf-76cd-4091-a21c-32125fd2fe3a" returned: 0 in 0.851s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Acquiring lock "cinder-7526b979-50b3-4095-bbe7-9750b975a786-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-0678faaf-76cd-4091-a21c-32125fd2fe3a" released by "delete_volume" :: held 2.201s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Lock "cinder-7526b979-50b3-4095-bbe7-9750b975a786-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Acquiring lock "cinder-quobyte-7526b979-50b3-4095-bbe7-9750b975a786" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created reservations ['eb67b459-2c6f-4071-9721-4c8572567c96', '05dbb1cb-06a7-4a4c-bc33-530a372dd4aa', '2f6949ce-9fed-4f64-bea2-bc033c5552dc', 'b625a545-d51c-4d90-a564-06cdb2a7a518'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Lock "cinder-quobyte-7526b979-50b3-4095-bbe7-9750b975a786" acquired by "delete_volume" :: waited 0.039s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf7cf0-d977-4d53-bb01-ff0b2691bfae]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:19 devstack sudo[96694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:19 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:19 devstack sudo[96693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786
Jul 06 15:35:19 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:20 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-353d09e2-e989-410c-995b-9e1024bb7b52-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786" returned: 0 in 1.014s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:20 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.972s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:20 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-353d09e2-e989-410c-995b-9e1024bb7b52-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:20 devstack sudo[96701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786
Jul 06 15:35:20 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:20 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=114,cinder:UPDATE=137,cinder:INSERT=32,cinder:DELETE=11 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:35:20 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Deleted volume successfully.
Jul 06 15:35:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1c78b701-3aee-4501-8bb3-9b7a434bd299 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-0678faaf-76cd-4091-a21c-32125fd2fe3a-delete_volume" released by "delete_volume" :: held 3.667s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-quobyte-353d09e2-e989-410c-995b-9e1024bb7b52" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-353d09e2-e989-410c-995b-9e1024bb7b52" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:21 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d76f854-08d6-4087-9452-69155465f3d7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:21 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52
Jul 06 15:35:21 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:21 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:21 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52" returned: 0 in 0.837s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7526b979-50b3-4095-bbe7-9750b975a786" returned: 0 in 1.039s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:21 devstack sudo[96710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52
Jul 06 15:35:21 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Lock "cinder-quobyte-7526b979-50b3-4095-bbe7-9750b975a786" released by "delete_volume" :: held 2.120s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:21 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=105,cinder:UPDATE=150,cinder:DELETE=16,cinder:INSERT=31 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:35:21 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Created reservations ['453c5168-7835-4a4d-bea4-7b6230e74828', '22a7ed5d-3731-4b9b-81bc-1fa8208c8ee5', 'fc32b14e-c5f5-4a68-a2de-04caeeb5b291', '3f996924-5c47-4d2a-8658-69b7c402afcd'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:22 devstack sudo[96712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:22 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:22 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-353d09e2-e989-410c-995b-9e1024bb7b52" returned: 0 in 0.757s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-353d09e2-e989-410c-995b-9e1024bb7b52" released by "delete_volume" :: held 1.642s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created reservations ['f53eb984-4f79-48a9-ae49-a0dd09d2bddc', '035b7d14-230b-44da-b981-fc6a46f237d0', '9fca97f8-c41d-4dc3-9b29-05b955f357cb', 'd915f257-c834-46f5-a7c8-eab86c09e8d4'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:22 devstack sudo[96721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:22 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:22 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.848s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:22 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Deleted volume successfully.
Jul 06 15:35:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-785c8737-100e-4262-add5-6185d8ff37fd tempest-AbsoluteLimitsTests-1237301735 None] Lock "cinder-7526b979-50b3-4095-bbe7-9750b975a786-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-5fcf1afe-4ed8-42f4-a587-bd92d32e140e-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-5fcf1afe-4ed8-42f4-a587-bd92d32e140e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-quobyte-5fcf1afe-4ed8-42f4-a587-bd92d32e140e" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-5fcf1afe-4ed8-42f4-a587-bd92d32e140e" acquired by "delete_volume" :: waited 0.037s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b16e4a-ab0d-4d97-894f-abd866e6ea59]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:23 devstack sudo[96724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e
Jul 06 15:35:23 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:23 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.188s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:24 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:24 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Deleted volume successfully.
Jul 06 15:35:24 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9b74e96f-825f-47b1-bf1f-8cf8de2bc87a tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-353d09e2-e989-410c-995b-9e1024bb7b52-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:24 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e" returned: 0 in 1.197s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:24 devstack sudo[96746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e
Jul 06 15:35:24 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:25 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5fcf1afe-4ed8-42f4-a587-bd92d32e140e" returned: 0 in 1.011s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-5fcf1afe-4ed8-42f4-a587-bd92d32e140e" released by "delete_volume" :: held 2.262s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:25 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created reservations ['81b1f7bf-b13f-4e0a-b5d3-f049ded92abc', '6f4757a6-9b84-4891-8150-da2a1ee5ac14', 'eb8a7a80-bde9-4483-8239-51bcf19c7a1c', '2adb6ab0-453b-49d6-8435-f4465f564b8f'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:25 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:25 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:26 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:26 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Deleted volume successfully.
Jul 06 15:35:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-30f57b40-abfe-4331-978f-da9d1f98790e tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-5fcf1afe-4ed8-42f4-a587-bd92d32e140e-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-quobyte-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8" acquired by "delete_volume" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:27 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c1c624-6a6e-4d1d-989a-78f2dca2a72d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:27 devstack sudo[96756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8
Jul 06 15:35:27 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:27 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8" returned: 0 in 0.913s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:28 devstack sudo[96761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8
Jul 06 15:35:28 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:28 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8" returned: 0 in 0.968s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8" released by "delete_volume" :: held 1.982s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created reservations ['e9cbbd39-5269-4de9-953d-f86fdb9d639f', '212ee2c5-cf07-4f9a-b8a9-f3c1d47deac5', 'dec01edb-47c6-4289-8079-68e89b39b616', '9febddb6-d1af-4d1b-a50e-5d7af3cdd1b9'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-c7784091-e76c-48f5-9d78-8698fcf1147c-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:29 devstack sudo[96764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:29 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-c7784091-e76c-48f5-9d78-8698fcf1147c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-quobyte-8b05b681-2eb9-4310-8e15-413bbdd2eccf" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-8b05b681-2eb9-4310-8e15-413bbdd2eccf" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-quobyte-c7784091-e76c-48f5-9d78-8698fcf1147c" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-c7784091-e76c-48f5-9d78-8698fcf1147c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Deleting offline snapshot c7784091-e76c-48f5-9d78-8698fcf1147c of volume 8b05b681-2eb9-4310-8e15-413bbdd2eccf {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] snapshot_file for this snap is: volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[269561af-247b-48dd-833a-b365c5c7113c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:29 devstack sudo[96766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c
Jul 06 15:35:29 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Flow 'volume_create_manager' (be7672ee-c5dc-4222-b795-9ec4444def2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23537e7-4856-42be-a261-f576d16ae6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23537e7-4856-42be-a261-f576d16ae6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-888832783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b9be19-3220-42ba-bad5-2a4816764aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab8ebffd3c24e03beefb2ecf93fe899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:30Z,use_quota=True,user_id='6048eff5d5bf4ffc84fd5065f238c86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d6b054-7e6a-47dc-a8e6-8a77d648e5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d6b054-7e6a-47dc-a8e6-8a77d648e5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d38c54a-d95c-4393-8486-aebe3213c490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:29 devstack cinder-volume[86249]: DEBUG cinder.image.glance [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Creating Keystone auth plugin from conf {{(pid=86249) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 15:35:30 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d38c54a-d95c-4393-8486-aebe3213c490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58b9be19-3220-42ba-bad5-2a4816764aa3', 'volume_name': 'volume-58b9be19-3220-42ba-bad5-2a4816764aa3', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8e7d9d0>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e9da59-3031-4fc1-b970-ec34241238d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e9da59-3031-4fc1-b970-ec34241238d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594d9e2f-c4fa-4281-8668-521416e363c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:30 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Volume 58b9be19-3220-42ba-bad5-2a4816764aa3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58b9be19-3220-42ba-bad5-2a4816764aa3', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8e7d9d0>}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Trying to clone 58b9be19-3220-42ba-bad5-2a4816764aa3 from image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]). {{(pid=86249) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.900s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:30 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Deleted volume successfully.
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87ec4e5d-0e6e-4f8c-934d-e53a9e032c9f tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-0d1a2de3-6d2a-4b0c-9569-ebee573cb1a8-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:30 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c" returned: 0 in 1.078s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad15e5a-bf4f-4401-8b55-c06a502008e4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 15:35:30 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca4f8ac-6e62-4902-b7b2-58da0db7fb56]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:30 devstack sudo[96775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf
Jul 06 15:35:30 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:30 devstack sudo[96776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD
Jul 06 15:35:30 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:31 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf" returned: 0 in 0.953s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:31 devstack sudo[96785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c
Jul 06 15:35:31 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:31 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD" returned: 0 in 0.961s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:31 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Temporary image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 is fetched for user 6048eff5d5bf4ffc84fd5065f238c86a. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 15:35:31 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bc8baf-6273-4345-b929-5d60d6d533a3]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:31 devstack sudo[96787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD
Jul 06 15:35:31 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:32 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:32 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD" returned: 0 in 0.875s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-888832783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b9be19-3220-42ba-bad5-2a4816764aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab8ebffd3c24e03beefb2ecf93fe899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:30Z,use_quota=True,user_id='6048eff5d5bf4ffc84fd5065f238c86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Creating volume 58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:35:32 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c" returned: 0 in 1.066s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:32 devstack sudo[96796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 1073741824
Jul 06 15:35:32 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:32 devstack sudo[96797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c
Jul 06 15:35:32 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:33 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf.c7784091-e76c-48f5-9d78-8698fcf1147c" returned: 0 in 0.696s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-c7784091-e76c-48f5-9d78-8698fcf1147c" released by "_delete_snapshot" :: held 3.922s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-8b05b681-2eb9-4310-8e15-413bbdd2eccf" released by "delete_snapshot" :: held 3.954s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created reservations ['aed97097-8d67-4b62-b9fe-6a3143a9f412', '9d5e6ed2-32a7-4cf5-8f00-592d1ea042f8', '272bec5d-0eae-465a-9832-56a8480e5422', '390e9416-349c-45d8-972a-9446301d70d5'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Delete snapshot completed successfully.
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-43784d1f-82ea-43e4-9df9-6113ae9a7d4d tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-c7784091-e76c-48f5-9d78-8698fcf1147c-delete_snapshot" released by "delete_snapshot" :: held 4.116s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:33 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 1073741824" returned: 0 in 0.937s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:33 devstack sudo[96805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3
Jul 06 15:35:33 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-8b05b681-2eb9-4310-8e15-413bbdd2eccf-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-8b05b681-2eb9-4310-8e15-413bbdd2eccf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "cinder-quobyte-8b05b681-2eb9-4310-8e15-413bbdd2eccf" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-8b05b681-2eb9-4310-8e15-413bbdd2eccf" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8198647-b416-4728-934a-aca48bdf0fe6]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:33 devstack sudo[96807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf
Jul 06 15:35:33 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:34 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3" returned: 0 in 0.703s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:35:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:34 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Attempting download of af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 ((None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}])) to volume 58b9be19-3220-42ba-bad5-2a4816764aa3. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 15:35:34 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[407c1987-11f2-4eef-9977-9140952c2b35]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qys5s53y {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:34 devstack sudo[96810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qys5s53y
Jul 06 15:35:34 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf" returned: 0 in 0.872s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:34 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:34 devstack sudo[96815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf
Jul 06 15:35:34 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:35 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qys5s53y" returned: 0 in 0.855s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qys5s53y {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:35 devstack sudo[96819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qys5s53y
Jul 06 15:35:35 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:35 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8b05b681-2eb9-4310-8e15-413bbdd2eccf" returned: 0 in 0.711s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-quobyte-8b05b681-2eb9-4310-8e15-413bbdd2eccf" released by "delete_volume" :: held 1.674s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Created reservations ['2e5fcaeb-c97e-40c4-a218-fcf160db0d2a', 'c2e799d0-0215-4dcf-9b78-5d91294ba625', 'd669893f-f84e-4f85-8dce-41118f222e2e', '6b64cf3a-e9a9-4ccd-bcf1-75f3fe8d2ee1'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:35 devstack sudo[96822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:35 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:35 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qys5s53y" returned: 1 in 0.813s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qys5s53y' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff00bad-46e6-4434-85ec-850dfcc83fde]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:36 devstack sudo[96826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD
Jul 06 15:35:36 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:36 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.735s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:36 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Deleted volume successfully.
Jul 06 15:35:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a0a3f35d-3bcf-499a-9e35-3d16d23c5108 tempest-CreateVolumesFromSnapshotTest-1651366564 None] Lock "cinder-8b05b681-2eb9-4310-8e15-413bbdd2eccf-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:36 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD" returned: 0 in 0.888s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:36 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 was qcow2, converting to raw {{(pid=86249) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 15:35:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:36 devstack sudo[96834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3
Jul 06 15:35:36 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Flow 'volume_create_manager' (ff3a165b-b576-4009-8d81-164615ab75d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cae2df5-78d3-419a-8a10-43acdbc14598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cae2df5-78d3-419a-8a10-43acdbc14598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1388025672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a1dc16-4455-41fb-b518-e0adacad1f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb953ebe2d704ddbbb76386a23665f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:38Z,use_quota=True,user_id='a6844e2faead4b5493e349bfae34b5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540f9a38-4508-4db3-a9e9-1218c6c77d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540f9a38-4508-4db3-a9e9-1218c6c77d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d9fb52-b2f5-4059-939d-736d15f18e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d9fb52-b2f5-4059-939d-736d15f18e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75a1dc16-4455-41fb-b518-e0adacad1f2e', 'volume_name': 'volume-75a1dc16-4455-41fb-b518-e0adacad1f2e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91896a7f-d2e5-475c-a151-1a5690408812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91896a7f-d2e5-475c-a151-1a5690408812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d7f81d-938a-4f6a-bf4b-5eda18878e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:37 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Volume 75a1dc16-4455-41fb-b518-e0adacad1f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75a1dc16-4455-41fb-b518-e0adacad1f2e', 'volume_size': 1}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1388025672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a1dc16-4455-41fb-b518-e0adacad1f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb953ebe2d704ddbbb76386a23665f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:38Z,use_quota=True,user_id='a6844e2faead4b5493e349bfae34b5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Creating volume 75a1dc16-4455-41fb-b518-e0adacad1f2e {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:35:37 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:35:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:37 devstack sudo[96841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e 1073741824
Jul 06 15:35:37 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:39 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e 1073741824" returned: 0 in 1.486s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:39 devstack sudo[96855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e
Jul 06 15:35:39 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:39 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3" returned: 0 in 2.895s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:39 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_mc_0shyfdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:35:39 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Converted 112.00 MB image at 38.68 MB/s
Jul 06 15:35:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:39 devstack sudo[96861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 1G
Jul 06 15:35:39 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:40 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e" returned: 0 in 1.073s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:35:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.646s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d7f81d-938a-4f6a-bf4b-5eda18878e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a1dc16-4455-41fb-b518-e0adacad1f2e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee39acc-d6f4-4880-ab7c-0c4dc67d814e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:40 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Volume volume-75a1dc16-4455-41fb-b518-e0adacad1f2e (75a1dc16-4455-41fb-b518-e0adacad1f2e): created successfully
Jul 06 15:35:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee39acc-d6f4-4880-ab7c-0c4dc67d814e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Flow 'volume_create_manager' (ff3a165b-b576-4009-8d81-164615ab75d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:40 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6244e446-4ed3-4b57-9b4b-d75d78e1e865 tempest-AttachVolumeNegativeTest-2009578222 None] Created volume successfully.
Jul 06 15:35:40 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 1G" returned: 0 in 0.962s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:40 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb683a-fa75-4b46-ab8c-af4d0366cfb0]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:40 devstack sudo[96868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3
Jul 06 15:35:40 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:41 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3" returned: 0 in 1.033s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:41 devstack sudo[96875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3
Jul 06 15:35:41 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:42 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3" returned: 1 in 0.963s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Downloaded image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 ((None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}])) to volume 58b9be19-3220-42ba-bad5-2a4816764aa3 successfully. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Temporary image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 for user 6048eff5d5bf4ffc84fd5065f238c86a is deleted. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Marking volume 58b9be19-3220-42ba-bad5-2a4816764aa3 as bootable. {{(pid=86249) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Copying metadata from image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 to 58b9be19-3220-42ba-bad5-2a4816764aa3. {{(pid=86249) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Creating volume glance metadata for volume 58b9be19-3220-42ba-bad5-2a4816764aa3 backed by image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86249) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594d9e2f-c4fa-4281-8668-521416e363c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b9be19-3220-42ba-bad5-2a4816764aa3', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8e7d9d0>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a07497-11ec-4c64-a467-1c7172842126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:42 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Volume volume-58b9be19-3220-42ba-bad5-2a4816764aa3 (58b9be19-3220-42ba-bad5-2a4816764aa3): created successfully
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a07497-11ec-4c64-a467-1c7172842126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Flow 'volume_create_manager' (be7672ee-c5dc-4222-b795-9ec4444def2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Flow 'volume_create_manager' (91a5f943-2656-4de3-8b84-d4a707e3191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a17bd2-0f6d-4687-91fb-5c3a64d5d98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a17bd2-0f6d-4687-91fb-5c3a64d5d98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848b4494-0a35-45bc-93cf-a6cedfcc7047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa987363fcc54fd9ac1c96655e2b64c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:43Z,use_quota=True,user_id='d253c2f8b045480898d63b928178697c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7436a33a-5a1a-475d-b251-711de7fed86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7436a33a-5a1a-475d-b251-711de7fed86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494e5dab-870c-4d44-a492-7ce33a948922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:42 devstack cinder-volume[86249]: DEBUG cinder.image.glance [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Creating Keystone auth plugin from conf {{(pid=86249) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 15:35:42 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-446426ab-8998-44be-bc50-1413a37438f9 tempest-VolumesExtendTest-1568993665 None] Created volume successfully.
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494e5dab-870c-4d44-a492-7ce33a948922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '848b4494-0a35-45bc-93cf-a6cedfcc7047', 'volume_name': 'volume-848b4494-0a35-45bc-93cf-a6cedfcc7047', 'volume_size': 1, 'image_id': '61241ffc-74c0-47cb-924a-3a65e0ef824c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61241ffc-74c0-47cb-924a-3a65e0ef824c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '313ff41a73e40d5bd39fd96916284f6c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fa987363fcc54fd9ac1c96655e2b64c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc3fc223cf9b18c07d27ab6c0f48502c44648c45dfb05d1fe2a34d4c477e3f3371925454ce8834ed95472662417639918bd8cbe0da922ad22f9319fc41236af1', 'id': '61241ffc-74c0-47cb-924a-3a65e0ef824c', 'created_at': datetime.datetime(2026, 7, 6, 13, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61241ffc-74c0-47cb-924a-3a65e0ef824c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8f7a810>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc43b2b-c605-4807-843f-5661054778cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc43b2b-c605-4807-843f-5661054778cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031f4c33-536e-4d3b-8530-ac3c55840300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:43 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Volume 848b4494-0a35-45bc-93cf-a6cedfcc7047: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-848b4494-0a35-45bc-93cf-a6cedfcc7047', 'volume_size': 1, 'image_id': '61241ffc-74c0-47cb-924a-3a65e0ef824c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61241ffc-74c0-47cb-924a-3a65e0ef824c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '313ff41a73e40d5bd39fd96916284f6c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fa987363fcc54fd9ac1c96655e2b64c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc3fc223cf9b18c07d27ab6c0f48502c44648c45dfb05d1fe2a34d4c477e3f3371925454ce8834ed95472662417639918bd8cbe0da922ad22f9319fc41236af1', 'id': '61241ffc-74c0-47cb-924a-3a65e0ef824c', 'created_at': datetime.datetime(2026, 7, 6, 13, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61241ffc-74c0-47cb-924a-3a65e0ef824c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8f7a810>}
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Trying to clone 848b4494-0a35-45bc-93cf-a6cedfcc7047 from image 61241ffc-74c0-47cb-924a-3a65e0ef824c at location (None, [{'url': 'file:///opt/stack/data/glance/images/61241ffc-74c0-47cb-924a-3a65e0ef824c', 'metadata': {}}]). {{(pid=86249) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 15:35:43 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[35116baa-e5d7-40fa-88c5-e5b302e00769]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:43 devstack sudo[96880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD
Jul 06 15:35:43 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de57e09-f58d-4140-9101-6b5705d4fdfc]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-82109e7b-ec42-4f8a-8ed3-20b1cf3aff9e req-beeebe3e-aaf2-4799-baf1-c35dcd58ec53 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:44 devstack sudo[96890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3
Jul 06 15:35:44 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:44 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD" returned: 0 in 0.932s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:44 devstack sudo[96894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD
Jul 06 15:35:44 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:44 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3" returned: 0 in 0.901s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:44 devstack sudo[96898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3
Jul 06 15:35:44 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:45 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD" returned: 1 in 1.118s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Temporary image 61241ffc-74c0-47cb-924a-3a65e0ef824c is fetched for user d253c2f8b045480898d63b928178697c. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb81e7ad-53f1-43de-813f-bf579103edb2]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:45 devstack sudo[96903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD
Jul 06 15:35:45 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:45 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3" returned: 1 in 0.946s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 2G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 2G" returned: 0 in 0.072s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.981s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-82109e7b-ec42-4f8a-8ed3-20b1cf3aff9e req-beeebe3e-aaf2-4799-baf1-c35dcd58ec53 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.838s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8951c-8480-47e2-a0f2-f377c2b5d125]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-82109e7b-ec42-4f8a-8ed3-20b1cf3aff9e req-beeebe3e-aaf2-4799-baf1-c35dcd58ec53 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:45 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3507b5cb-a46a-4ebe-a706-336d25408d9a tempest-VolumesExtendTest-1568993665 None] Extend volume completed successfully.
Jul 06 15:35:46 devstack sudo[96911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e
Jul 06 15:35:46 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:46 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:46 devstack sudo[96915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD
Jul 06 15:35:46 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "cinder-58b9be19-3220-42ba-bad5-2a4816764aa3-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-58b9be19-3220-42ba-bad5-2a4816764aa3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "cinder-quobyte-58b9be19-3220-42ba-bad5-2a4816764aa3" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-quobyte-58b9be19-3220-42ba-bad5-2a4816764aa3" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36e4003-8b66-4e8d-9a28-4b37825b0cf5]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:46 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-82109e7b-ec42-4f8a-8ed3-20b1cf3aff9e req-beeebe3e-aaf2-4799-baf1-c35dcd58ec53 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e" returned: 0 in 0.967s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-82109e7b-ec42-4f8a-8ed3-20b1cf3aff9e req-beeebe3e-aaf2-4799-baf1-c35dcd58ec53 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.995s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-82109e7b-ec42-4f8a-8ed3-20b1cf3aff9e req-beeebe3e-aaf2-4799-baf1-c35dcd58ec53 tempest-AttachVolumeNegativeTest-2009578222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-75a1dc16-4455-41fb-b518-e0adacad1f2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c32fae3-1f0d-4de1-b53d-709f4d6f751f', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:35:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-82109e7b-ec42-4f8a-8ed3-20b1cf3aff9e req-beeebe3e-aaf2-4799-baf1-c35dcd58ec53 tempest-AttachVolumeNegativeTest-2009578222 None] attachment_update completed successfully.
Jul 06 15:35:47 devstack sudo[96921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3
Jul 06 15:35:47 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:47 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD" returned: 1 in 0.927s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848b4494-0a35-45bc-93cf-a6cedfcc7047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa987363fcc54fd9ac1c96655e2b64c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:43Z,use_quota=True,user_id='d253c2f8b045480898d63b928178697c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Creating volume 848b4494-0a35-45bc-93cf-a6cedfcc7047 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:35:47 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:47 devstack sudo[96991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 1073741824
Jul 06 15:35:47 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:47 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3" returned: 0 in 1.050s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:48 devstack sudo[96998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3
Jul 06 15:35:48 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:48 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 1073741824" returned: 0 in 1.084s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:48 devstack sudo[97318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047
Jul 06 15:35:48 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:48 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3" returned: 1 in 0.948s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:35:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:48 devstack sudo[97323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3
Jul 06 15:35:48 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:49 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047" returned: 0 in 0.724s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Attempting download of 61241ffc-74c0-47cb-924a-3a65e0ef824c ((None, [{'url': 'file:///opt/stack/data/glance/images/61241ffc-74c0-47cb-924a-3a65e0ef824c', 'metadata': {}}])) to volume 848b4494-0a35-45bc-93cf-a6cedfcc7047. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a7ae66-03b0-49ff-a76e-a8d6d7093b73]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61241ffc-74c0-47cb-924a-3a65e0ef824c_1t9tcc91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:49 devstack sudo[97326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61241ffc-74c0-47cb-924a-3a65e0ef824c_1t9tcc91
Jul 06 15:35:49 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:49 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-58b9be19-3220-42ba-bad5-2a4816764aa3" returned: 0 in 0.724s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-quobyte-58b9be19-3220-42ba-bad5-2a4816764aa3" released by "delete_volume" :: held 2.835s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Created reservations ['0d8a1248-79c9-4534-b69a-9de91ccc51d1', '2c4e30ee-3586-412a-8c95-6fdf8b24ba80', 'ed71a42b-ef09-4505-819e-3a265e45dafa', '76259422-138e-458d-a7a0-45a0a9c3b028'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:49 devstack sudo[97330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:35:49 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:50 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61241ffc-74c0-47cb-924a-3a65e0ef824c_1t9tcc91" returned: 0 in 0.816s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61241ffc-74c0-47cb-924a-3a65e0ef824c_1t9tcc91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:50 devstack sudo[97334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61241ffc-74c0-47cb-924a-3a65e0ef824c_1t9tcc91
Jul 06 15:35:50 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:50 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.801s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:35:50 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Deleted volume successfully.
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f5eabfe0-5a59-4e45-a3b9-ef9fd1cb4055 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-58b9be19-3220-42ba-bad5-2a4816764aa3-delete_volume" released by "delete_volume" :: held 3.931s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Flow 'volume_create_manager' (e2a5a3f8-64fe-4c2e-9266-cb33096a9a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450bdd1b-0ee9-47dc-8675-34e475957e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450bdd1b-0ee9-47dc-8675-34e475957e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-209003142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1333448b-bae1-4cc6-99ca-655083ef8161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab8ebffd3c24e03beefb2ecf93fe899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:51Z,use_quota=True,user_id='6048eff5d5bf4ffc84fd5065f238c86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c748312-52c8-4df9-b924-05cc84e096c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c748312-52c8-4df9-b924-05cc84e096c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29378d93-8e18-4e22-8d82-0b993123af68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29378d93-8e18-4e22-8d82-0b993123af68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1333448b-bae1-4cc6-99ca-655083ef8161', 'volume_name': 'volume-1333448b-bae1-4cc6-99ca-655083ef8161', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0c3715-016b-4403-a95a-527fb842b073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0c3715-016b-4403-a95a-527fb842b073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5572ef88-6f41-40ae-b81e-72562affe511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:50 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Volume 1333448b-bae1-4cc6-99ca-655083ef8161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1333448b-bae1-4cc6-99ca-655083ef8161', 'volume_size': 1}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-209003142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1333448b-bae1-4cc6-99ca-655083ef8161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab8ebffd3c24e03beefb2ecf93fe899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:51Z,use_quota=True,user_id='6048eff5d5bf4ffc84fd5065f238c86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Creating volume 1333448b-bae1-4cc6-99ca-655083ef8161 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:35:50 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:35:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:50 devstack sudo[97337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161 1073741824
Jul 06 15:35:50 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:51 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61241ffc-74c0-47cb-924a-3a65e0ef824c_1t9tcc91" returned: 1 in 1.029s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61241ffc-74c0-47cb-924a-3a65e0ef824c_1t9tcc91' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:35:51 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9639a4-7c8c-4ed5-b0d9-45f1960a7303]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:51 devstack sudo[97341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD
Jul 06 15:35:51 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:51 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161 1073741824" returned: 0 in 1.135s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:51 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD" returned: 0 in 0.883s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:52 devstack sudo[97350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161
Jul 06 15:35:52 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:52 devstack sudo[97349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD
Jul 06 15:35:52 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD" returned: 1 in 0.861s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:35:52 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] 61241ffc-74c0-47cb-924a-3a65e0ef824c was raw, converting to raw {{(pid=86249) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 15:35:52 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:52 devstack sudo[97357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047
Jul 06 15:35:52 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:52 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161" returned: 0 in 0.967s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] <== create_volume: return (2194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:35:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:35:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5572ef88-6f41-40ae-b81e-72562affe511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1333448b-bae1-4cc6-99ca-655083ef8161', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9751fe-f577-4bbf-a805-9176191e990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:53 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Volume volume-1333448b-bae1-4cc6-99ca-655083ef8161 (1333448b-bae1-4cc6-99ca-655083ef8161): created successfully
Jul 06 15:35:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9751fe-f577-4bbf-a805-9176191e990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Flow 'volume_create_manager' (e2a5a3f8-64fe-4c2e-9266-cb33096a9a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:53 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-43e56fbf-030c-4fad-9995-01d0b635d0e9 tempest-VolumesExtendTest-1568993665 None] Created volume successfully.
Jul 06 15:35:53 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-07a916d4-60c1-45eb-a695-1124dec7c004 req-aff357ce-7351-4807-a02c-5055c221205a tempest-AttachVolumeNegativeTest-2009578222 None] Terminate volume connection completed successfully.
Jul 06 15:35:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-07a916d4-60c1-45eb-a695-1124dec7c004 req-aff357ce-7351-4807-a02c-5055c221205a tempest-AttachVolumeNegativeTest-2009578222 None] Deleting attachment 7c32fae3-1f0d-4de1-b53d-709f4d6f751f. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:35:53 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047" returned: 0 in 0.939s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:53 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61241ffc-74c0-47cb-924a-3a65e0ef824c_pmfx6d_edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:35:53 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 15:35:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:53 devstack sudo[97391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 1G
Jul 06 15:35:53 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:35:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:35:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Creating offline snapshot a501cfca-210d-4d43-acda-f4668220572c of volume 1333448b-bae1-4cc6-99ca-655083ef8161 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:35:54 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6ec520-8720-449e-a063-c7e99fa66c65]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:54 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161
Jul 06 15:35:54 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:54 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 1G" returned: 0 in 1.108s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:54 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c584354c-ee4d-41fc-b99c-ee7c69ed10e2]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:55 devstack sudo[97398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047
Jul 06 15:35:55 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:55 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161" returned: 0 in 1.003s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:55 devstack sudo[97403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c 1G
Jul 06 15:35:55 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:55 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047" returned: 0 in 0.985s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:56 devstack sudo[97407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047
Jul 06 15:35:56 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:56 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c 1G" returned: 0 in 1.249s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1333448b-bae1-4cc6-99ca-655083ef8161 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:56 devstack sudo[97412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1333448b-bae1-4cc6-99ca-655083ef8161 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c
Jul 06 15:35:56 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:57 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047" returned: 1 in 1.168s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Downloaded image 61241ffc-74c0-47cb-924a-3a65e0ef824c ((None, [{'url': 'file:///opt/stack/data/glance/images/61241ffc-74c0-47cb-924a-3a65e0ef824c', 'metadata': {}}])) to volume 848b4494-0a35-45bc-93cf-a6cedfcc7047 successfully. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Temporary image 61241ffc-74c0-47cb-924a-3a65e0ef824c for user d253c2f8b045480898d63b928178697c is deleted. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Marking volume 848b4494-0a35-45bc-93cf-a6cedfcc7047 as bootable. {{(pid=86249) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Copying metadata from image 61241ffc-74c0-47cb-924a-3a65e0ef824c to 848b4494-0a35-45bc-93cf-a6cedfcc7047. {{(pid=86249) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Creating volume glance metadata for volume 848b4494-0a35-45bc-93cf-a6cedfcc7047 backed by image 61241ffc-74c0-47cb-924a-3a65e0ef824c with: {'image_id': '61241ffc-74c0-47cb-924a-3a65e0ef824c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '313ff41a73e40d5bd39fd96916284f6c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86249) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031f4c33-536e-4d3b-8530-ac3c55840300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848b4494-0a35-45bc-93cf-a6cedfcc7047', 'volume_size': 1, 'image_id': '61241ffc-74c0-47cb-924a-3a65e0ef824c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61241ffc-74c0-47cb-924a-3a65e0ef824c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '313ff41a73e40d5bd39fd96916284f6c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fa987363fcc54fd9ac1c96655e2b64c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc3fc223cf9b18c07d27ab6c0f48502c44648c45dfb05d1fe2a34d4c477e3f3371925454ce8834ed95472662417639918bd8cbe0da922ad22f9319fc41236af1', 'id': '61241ffc-74c0-47cb-924a-3a65e0ef824c', 'created_at': datetime.datetime(2026, 7, 6, 13, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61241ffc-74c0-47cb-924a-3a65e0ef824c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8f7a810>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708bbdcb-aedf-4f3f-8cc3-aa0bbf74bf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:35:57 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Volume volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 (848b4494-0a35-45bc-93cf-a6cedfcc7047): created successfully
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708bbdcb-aedf-4f3f-8cc3-aa0bbf74bf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Flow 'volume_create_manager' (91a5f943-2656-4de3-8b84-d4a707e3191f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:35:57 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8b7979ed-97db-46f8-964a-00a24756dbc1 tempest-VolumeImageDependencyTests-1571269509 None] Created volume successfully.
Jul 06 15:35:57 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1333448b-bae1-4cc6-99ca-655083ef8161 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c" returned: 0 in 1.194s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:57 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c is being set with open permissions: ugo+rw
Jul 06 15:35:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:57 devstack sudo[97438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c
Jul 06 15:35:57 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Acquiring lock "cinder-848b4494-0a35-45bc-93cf-a6cedfcc7047-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Lock "cinder-848b4494-0a35-45bc-93cf-a6cedfcc7047-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Acquiring lock "cinder-quobyte-848b4494-0a35-45bc-93cf-a6cedfcc7047" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:35:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Lock "cinder-quobyte-848b4494-0a35-45bc-93cf-a6cedfcc7047" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:35:58 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6524230-ba4b-4f90-8068-81f912d8f529]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:35:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:58 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c" returned: 0 in 0.748s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:58 devstack sudo[97445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047
Jul 06 15:35:58 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:58 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.info
Jul 06 15:35:58 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:59 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047" returned: 0 in 1.018s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:59 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Jul 06 15:35:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.info" returned: 0 in 0.938s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:35:59 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.info is being set with open permissions: ugo+rw
Jul 06 15:35:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:35:59 devstack sudo[97455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.info
Jul 06 15:35:59 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:35:59 devstack sudo[97454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047
Jul 06 15:35:59 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:00 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.info" returned: 0 in 0.680s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.927s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:00 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f2d55ed7-6875-4601-85c9-9fc33d909027 tempest-VolumesExtendTest-1568993665 None] Create snapshot completed successfully
Jul 06 15:36:00 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047" returned: 1 in 0.826s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:36:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:00 devstack sudo[97463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047
Jul 06 15:36:00 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-91a05b4f-1b57-400b-8fea-bcdab47dbf63 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-91a05b4f-1b57-400b-8fea-bcdab47dbf63 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:00 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46dc225-e665-46ae-ba2d-8445da138a3f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-91a05b4f-1b57-400b-8fea-bcdab47dbf63 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Flow 'volume_create_manager' (0402ee0a-10bd-4049-ae5f-a2b41c5db3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d9d788-de48-4c71-b252-69658610c485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d9d788-de48-4c71-b252-69658610c485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1218163032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5f6daf-842a-4306-a2ec-5ddeccabdbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42984dec38e54c7d976012e74a52c90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:01Z,use_quota=True,user_id='4b0b883b806142918492dd97209134d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:01 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bca1573-a5fa-41a6-82bb-5207610d8deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bca1573-a5fa-41a6-82bb-5207610d8deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:01 devstack sudo[97466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161
Jul 06 15:36:01 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc01764-a95c-40f1-a6fd-320a3787e3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc01764-a95c-40f1-a6fd-320a3787e3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5f6daf-842a-4306-a2ec-5ddeccabdbaf', 'volume_name': 'volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6be744-2df2-422c-98f7-1fe175adedbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6be744-2df2-422c-98f7-1fe175adedbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457caa89-c9c3-4c8f-93da-8ba58eec0dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:01 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Volume 2f5f6daf-842a-4306-a2ec-5ddeccabdbaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf', 'volume_size': 1}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-848b4494-0a35-45bc-93cf-a6cedfcc7047" returned: 0 in 0.773s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Lock "cinder-quobyte-848b4494-0a35-45bc-93cf-a6cedfcc7047" released by "delete_volume" :: held 2.692s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Created reservations ['302ef74b-0c54-4ac4-9562-44c4a72f7a22', 'a4ea4a97-f2da-410e-bc30-658ad95c3e18', 'ffcac8d8-72a5-46c1-af78-13886a5dfa3a', '0c0aeba0-0b3d-47b9-82e9-6cb3901fc18d'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:01 devstack sudo[97468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:36:01 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:02 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-91a05b4f-1b57-400b-8fea-bcdab47dbf63 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161" returned: 0 in 1.049s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-91a05b4f-1b57-400b-8fea-bcdab47dbf63 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c 2G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:02 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.815s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:36:02 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Deleted volume successfully.
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9717f723-ab5b-421e-b8f3-29c49117d5e9 tempest-VolumeImageDependencyTests-1571269509 None] Lock "cinder-848b4494-0a35-45bc-93cf-a6cedfcc7047-delete_volume" released by "delete_volume" :: held 3.799s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-91a05b4f-1b57-400b-8fea-bcdab47dbf63 tempest-VolumesExtendTest-1568993665 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c 2G" returned: 0 in 0.228s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-91a05b4f-1b57-400b-8fea-bcdab47dbf63 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.339s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1218163032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5f6daf-842a-4306-a2ec-5ddeccabdbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42984dec38e54c7d976012e74a52c90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:01Z,use_quota=True,user_id='4b0b883b806142918492dd97209134d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Creating volume 2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:36:02 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:36:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:02 devstack sudo[97481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf 1073741824
Jul 06 15:36:02 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:02 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-91a05b4f-1b57-400b-8fea-bcdab47dbf63 tempest-VolumesExtendTest-1568993665 None] Extend volume completed successfully.
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "cinder-a501cfca-210d-4d43-acda-f4668220572c-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-a501cfca-210d-4d43-acda-f4668220572c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "cinder-quobyte-1333448b-bae1-4cc6-99ca-655083ef8161" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-quobyte-1333448b-bae1-4cc6-99ca-655083ef8161" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "cinder-quobyte-a501cfca-210d-4d43-acda-f4668220572c" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-quobyte-a501cfca-210d-4d43-acda-f4668220572c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Deleting offline snapshot a501cfca-210d-4d43-acda-f4668220572c of volume 1333448b-bae1-4cc6-99ca-655083ef8161 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] snapshot_file for this snap is: volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[122a78c0-604b-4595-bdcc-f7a83c7d2809]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:03 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf 1073741824" returned: 0 in 1.228s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:03 devstack sudo[97487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c
Jul 06 15:36:03 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:03 devstack sudo[97489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf
Jul 06 15:36:03 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:04 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c" returned: 0 in 1.057s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1333448b-bae1-4cc6-99ca-655083ef8161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fa0b21-190d-4b7b-996a-5a06a0670c79]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:04 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" returned: 0 in 0.945s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457caa89-c9c3-4c8f-93da-8ba58eec0dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1765df2-42be-40d0-b8cb-bd7b911e9bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:04 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Volume volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf (2f5f6daf-842a-4306-a2ec-5ddeccabdbaf): created successfully
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1765df2-42be-40d0-b8cb-bd7b911e9bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Flow 'volume_create_manager' (0402ee0a-10bd-4049-ae5f-a2b41c5db3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a98bf494-d133-4d2c-91de-1feb97648291 tempest-TestStampPattern-1993956774 None] Created volume successfully.
Jul 06 15:36:04 devstack sudo[97495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161
Jul 06 15:36:04 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:05 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161" returned: 0 in 0.874s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:05 devstack sudo[97500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c
Jul 06 15:36:05 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Flow 'volume_create_manager' (021c9052-bbdd-464f-a5b7-a491f8aeac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a900cdd2-b2ca-4b59-ba58-b85a834f5020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a900cdd2-b2ca-4b59-ba58-b85a834f5020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9303ea-5c7a-416f-a76c-c602bd07aade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb998d210f840a6acdd87eea2015ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:06Z,use_quota=True,user_id='da224ce57153471ea936e02c0532c6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef80ec5-e8bb-40aa-9d7e-789408308fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef80ec5-e8bb-40aa-9d7e-789408308fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb091d1-c663-4d43-a60c-13410fee8076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb091d1-c663-4d43-a60c-13410fee8076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9303ea-5c7a-416f-a76c-c602bd07aade', 'volume_name': 'volume-fd9303ea-5c7a-416f-a76c-c602bd07aade', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5992f9b-572f-4d4b-96d4-0bb7ab45336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5992f9b-572f-4d4b-96d4-0bb7ab45336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6dd439-d595-4af3-8290-60942a13fbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:05 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Volume fd9303ea-5c7a-416f-a76c-c602bd07aade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9303ea-5c7a-416f-a76c-c602bd07aade', 'volume_size': 1}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9303ea-5c7a-416f-a76c-c602bd07aade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb998d210f840a6acdd87eea2015ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:06Z,use_quota=True,user_id='da224ce57153471ea936e02c0532c6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Creating volume fd9303ea-5c7a-416f-a76c-c602bd07aade {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:36:05 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:36:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:06 devstack sudo[97502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade 1073741824
Jul 06 15:36:06 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:06 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c" returned: 0 in 0.896s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:06 devstack sudo[97508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c
Jul 06 15:36:06 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:36:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:06 devstack sudo[97513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:36:06 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:07 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade 1073741824" returned: 0 in 1.004s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:07 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161.a501cfca-210d-4d43-acda-f4668220572c" returned: 0 in 0.781s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:07 devstack sudo[97518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade
Jul 06 15:36:07 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-quobyte-a501cfca-210d-4d43-acda-f4668220572c" released by "_delete_snapshot" :: held 3.780s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-quobyte-1333448b-bae1-4cc6-99ca-655083ef8161" released by "delete_snapshot" :: held 3.817s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Created reservations ['b3faccc5-180c-4bf5-948d-da1bd913fe6d', '4ac6c827-19b1-46fe-afc0-6cbf4cf1f5e9', 'b896b7d7-deb1-4afb-b99d-9b803c86caa2', 'ac8e2940-c6a1-4357-9a6e-42f77230c649'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:36:07 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Delete snapshot completed successfully.
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-588f50bf-a3af-4be1-81b3-d9f30da6f1c8 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-a501cfca-210d-4d43-acda-f4668220572c-delete_snapshot" released by "delete_snapshot" :: held 4.206s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:07 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.899s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "cinder-1333448b-bae1-4cc6-99ca-655083ef8161-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-1333448b-bae1-4cc6-99ca-655083ef8161-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "cinder-quobyte-1333448b-bae1-4cc6-99ca-655083ef8161" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-quobyte-1333448b-bae1-4cc6-99ca-655083ef8161" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0111401c-a8e9-4152-adcd-3bee8b7d9be5]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:08 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade" returned: 0 in 0.996s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:36:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6dd439-d595-4af3-8290-60942a13fbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9303ea-5c7a-416f-a76c-c602bd07aade', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3deebd17-a2f9-4281-b943-4d1f059cb21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:08 devstack sudo[97522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161
Jul 06 15:36:08 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Volume volume-fd9303ea-5c7a-416f-a76c-c602bd07aade (fd9303ea-5c7a-416f-a76c-c602bd07aade): created successfully
Jul 06 15:36:08 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3deebd17-a2f9-4281-b943-4d1f059cb21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Flow 'volume_create_manager' (021c9052-bbdd-464f-a5b7-a491f8aeac20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:08 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-72aa80c6-d8c2-4daf-80c7-e38c94b4f2de tempest-CinderUnicodeTest-236720936 None] Created volume successfully.
Jul 06 15:36:09 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161" returned: 0 in 1.128s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:09 devstack sudo[97566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161
Jul 06 15:36:09 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Flow 'volume_create_manager' (03dec5e8-c21a-45b6-a23d-ab040b81a6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c577eb71-75aa-4dbb-83e2-68b84853dc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c577eb71-75aa-4dbb-83e2-68b84853dc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-735336247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6778af-101b-4ed3-b8fe-db59aa796d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb998d210f840a6acdd87eea2015ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:10Z,use_quota=True,user_id='da224ce57153471ea936e02c0532c6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601ae680-0d3b-4b51-9c52-370c9c1e0173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601ae680-0d3b-4b51-9c52-370c9c1e0173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (999ded68-2833-480e-8efc-8ac0550f1b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (999ded68-2833-480e-8efc-8ac0550f1b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6778af-101b-4ed3-b8fe-db59aa796d55', 'volume_name': 'volume-5e6778af-101b-4ed3-b8fe-db59aa796d55', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da16376-c932-42f0-944d-a9dfb1ee6323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:10 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da16376-c932-42f0-944d-a9dfb1ee6323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a2bb94-3516-457a-be14-791c8a5b5076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:10 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Volume 5e6778af-101b-4ed3-b8fe-db59aa796d55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6778af-101b-4ed3-b8fe-db59aa796d55', 'volume_size': 1}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-735336247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6778af-101b-4ed3-b8fe-db59aa796d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb998d210f840a6acdd87eea2015ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:10Z,use_quota=True,user_id='da224ce57153471ea936e02c0532c6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Creating volume 5e6778af-101b-4ed3-b8fe-db59aa796d55 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:36:10 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1333448b-bae1-4cc6-99ca-655083ef8161" returned: 0 in 1.096s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:10 devstack sudo[97590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 1073741824
Jul 06 15:36:10 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-quobyte-1333448b-bae1-4cc6-99ca-655083ef8161" released by "delete_volume" :: held 2.331s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Created reservations ['062e3a3a-3720-40f6-9e02-342203838578', 'c83b0266-f76f-4f26-b0a5-71ed48973e4e', 'b1c8e936-dd04-4e78-acec-b66d21e18d63', '311c7ae3-e54b-40be-8654-2511f042ae6b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:10 devstack sudo[97592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:36:10 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:11 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.717s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:36:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Deleted volume successfully.
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28dd02e9-2ea3-4312-8f76-52da261590c7 tempest-VolumesExtendTest-1568993665 None] Lock "cinder-1333448b-bae1-4cc6-99ca-655083ef8161-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:11 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 1073741824" returned: 0 in 0.958s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:11 devstack sudo[97599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55
Jul 06 15:36:11 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:11 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55" returned: 0 in 0.659s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a2bb94-3516-457a-be14-791c8a5b5076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6778af-101b-4ed3-b8fe-db59aa796d55', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848787b2-d8ca-4010-9f92-efa2a5ed948d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:11 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Volume volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 (5e6778af-101b-4ed3-b8fe-db59aa796d55): created successfully
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848787b2-d8ca-4010-9f92-efa2a5ed948d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Flow 'volume_create_manager' (03dec5e8-c21a-45b6-a23d-ab040b81a6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4fc354e2-6d04-48f2-b3c7-2c5747f87447 tempest-CinderUnicodeTest-236720936 None] Created volume successfully.
Jul 06 15:36:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Creating offline snapshot 8133fbbe-fb14-4b62-a220-6a08fc38a7d1 of volume 5e6778af-101b-4ed3-b8fe-db59aa796d55 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:36:12 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2702c31-0f56-4f32-ba92-cb3587eea98b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:12 devstack sudo[97602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55
Jul 06 15:36:12 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:13 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55" returned: 0 in 0.967s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:13 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1 1G
Jul 06 15:36:13 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:14 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1 1G" returned: 0 in 1.460s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:14 devstack sudo[97658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1
Jul 06 15:36:14 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:15 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1" returned: 0 in 1.028s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:15 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1 is being set with open permissions: ugo+rw
Jul 06 15:36:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:15 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1
Jul 06 15:36:15 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:16 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1" returned: 0 in 1.018s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:16 devstack sudo[97709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.info
Jul 06 15:36:17 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:17 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.info" returned: 0 in 0.938s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:17 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.info is being set with open permissions: ugo+rw
Jul 06 15:36:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:17 devstack sudo[97712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.info
Jul 06 15:36:17 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:18 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.info" returned: 0 in 0.831s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.366s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:18 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bb5e1109-6566-4804-b465-1614bafdf9b3 tempest-CinderUnicodeTest-236720936 None] Create snapshot completed successfully
Jul 06 15:36:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Acquiring lock "cinder-8133fbbe-fb14-4b62-a220-6a08fc38a7d1-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Lock "cinder-8133fbbe-fb14-4b62-a220-6a08fc38a7d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Acquiring lock "cinder-quobyte-5e6778af-101b-4ed3-b8fe-db59aa796d55" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Lock "cinder-quobyte-5e6778af-101b-4ed3-b8fe-db59aa796d55" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Acquiring lock "cinder-quobyte-8133fbbe-fb14-4b62-a220-6a08fc38a7d1" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Lock "cinder-quobyte-8133fbbe-fb14-4b62-a220-6a08fc38a7d1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Deleting offline snapshot 8133fbbe-fb14-4b62-a220-6a08fc38a7d1 of volume 5e6778af-101b-4ed3-b8fe-db59aa796d55 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:36:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] snapshot_file for this snap is: volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:36:20 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1499d0-2895-459a-9540-50eb6b17b53e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:20 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1
Jul 06 15:36:20 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:21 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1" returned: 0 in 1.532s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6778af-101b-4ed3-b8fe-db59aa796d55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:36:21 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15a4277-2019-41ed-a16b-e3a66148a2c4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:21 devstack sudo[97767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55
Jul 06 15:36:21 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:23 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55" returned: 0 in 1.851s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:23 devstack sudo[97799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1
Jul 06 15:36:23 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:25 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1" returned: 0 in 1.551s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:25 devstack sudo[97807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1
Jul 06 15:36:25 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:26 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55.8133fbbe-fb14-4b62-a220-6a08fc38a7d1" returned: 0 in 1.624s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:26 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:INSERT=36,cinder:UPDATE=101,cinder:SELECT=94,cinder:DELETE=5 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:36:26 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=93,cinder:INSERT=35,cinder:UPDATE=115,cinder:DELETE=12 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:36:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Lock "cinder-quobyte-8133fbbe-fb14-4b62-a220-6a08fc38a7d1" released by "_delete_snapshot" :: held 6.809s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Lock "cinder-quobyte-5e6778af-101b-4ed3-b8fe-db59aa796d55" released by "delete_snapshot" :: held 6.861s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:26 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Created reservations ['0f9b97bc-1eab-40d3-a0b2-983b512515ae', '1b7480d3-13e1-477b-a412-e5bceac8388b', '9fa6d26d-6b03-4f57-ab91-acfdef8af87a', '7d4c1e1d-0ff8-410c-be1b-5a4e58a5f788'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:36:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Delete snapshot completed successfully.
Jul 06 15:36:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c08232fb-73a5-42d5-b25b-5f5add404971 tempest-CinderUnicodeTest-236720936 None] Lock "cinder-8133fbbe-fb14-4b62-a220-6a08fc38a7d1-delete_snapshot" released by "delete_snapshot" :: held 7.152s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Acquiring lock "cinder-5e6778af-101b-4ed3-b8fe-db59aa796d55-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Lock "cinder-5e6778af-101b-4ed3-b8fe-db59aa796d55-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Acquiring lock "cinder-quobyte-5e6778af-101b-4ed3-b8fe-db59aa796d55" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Lock "cinder-quobyte-5e6778af-101b-4ed3-b8fe-db59aa796d55" acquired by "delete_volume" :: waited 0.044s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:27 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e81ea0-fc9d-485f-9c42-3aa99cb7d6c2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:28 devstack sudo[97812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55
Jul 06 15:36:28 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:29 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55" returned: 0 in 1.511s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:29 devstack sudo[97817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55
Jul 06 15:36:29 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:30 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5e6778af-101b-4ed3-b8fe-db59aa796d55" returned: 0 in 1.011s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Lock "cinder-quobyte-5e6778af-101b-4ed3-b8fe-db59aa796d55" released by "delete_volume" :: held 2.630s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:30 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Created reservations ['a9410311-8a2c-4a33-8e97-ec4c509d7b72', '890e789c-6872-4263-a0be-6b4b91260068', 'd00cfc1a-4486-4814-b9fc-1ca484d1198b', '4c5b278a-c945-4a06-8128-af87550401c1'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:36:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:30 devstack sudo[97856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:36:30 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Acquiring lock "cinder-fd9303ea-5c7a-416f-a76c-c602bd07aade-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Lock "cinder-fd9303ea-5c7a-416f-a76c-c602bd07aade-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Acquiring lock "cinder-quobyte-fd9303ea-5c7a-416f-a76c-c602bd07aade" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Lock "cinder-quobyte-fd9303ea-5c7a-416f-a76c-c602bd07aade" acquired by "delete_volume" :: waited 0.039s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:31 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bc71d2-a58e-4d16-9b17-e414d9faeb06]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:31 devstack sudo[97859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade
Jul 06 15:36:31 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:31 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.098s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:31 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:36:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Deleted volume successfully.
Jul 06 15:36:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bf20a01-51b1-4398-832b-963fff6ea2b3 tempest-CinderUnicodeTest-236720936 None] Lock "cinder-5e6778af-101b-4ed3-b8fe-db59aa796d55-delete_volume" released by "delete_volume" :: held 4.211s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:32 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade" returned: 0 in 1.056s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:32 devstack sudo[97865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade
Jul 06 15:36:32 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:33 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fd9303ea-5c7a-416f-a76c-c602bd07aade" returned: 0 in 0.825s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Lock "cinder-quobyte-fd9303ea-5c7a-416f-a76c-c602bd07aade" released by "delete_volume" :: held 1.948s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:33 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Created reservations ['126e2242-bee5-4bb9-8df7-dbbc41186a3f', '7ad97d11-0e28-4cc7-a553-6edcaed79f8b', '16061859-5cb1-4808-817c-27e68c807913', '5cdf5fbd-e503-4489-b7c2-73afcc24856c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:36:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:33 devstack sudo[97868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:36:33 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Flow 'volume_create_manager' (2869da87-6447-4faf-a599-a4160ca2cf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (babf0710-2708-48df-b185-dfc3a30f9fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (babf0710-2708-48df-b185-dfc3a30f9fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-380839094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2f0cea-2e9e-45ea-a2a6-5469180956c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5940cdc1fe8c4ded82be2498e1aa4582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:34Z,use_quota=True,user_id='f6d504c73ca14f209ec8b8bc2e482ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a652d3-a9f0-40c7-ad72-1a0666dc97a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a652d3-a9f0-40c7-ad72-1a0666dc97a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce8a224-a785-467b-89b3-1e19a12a711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce8a224-a785-467b-89b3-1e19a12a711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2f0cea-2e9e-45ea-a2a6-5469180956c2', 'volume_name': 'volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa9a22e-0509-41d8-bb97-d708242ca6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa9a22e-0509-41d8-bb97-d708242ca6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f16083d-518d-47e5-8696-02b54f2bccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:34 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Volume 5a2f0cea-2e9e-45ea-a2a6-5469180956c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2', 'volume_size': 1}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-380839094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2f0cea-2e9e-45ea-a2a6-5469180956c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5940cdc1fe8c4ded82be2498e1aa4582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:34Z,use_quota=True,user_id='f6d504c73ca14f209ec8b8bc2e482ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Creating volume 5a2f0cea-2e9e-45ea-a2a6-5469180956c2 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:36:34 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:34 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.886s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:36:34 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Deleted volume successfully.
Jul 06 15:36:34 devstack sudo[97871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 1073741824
Jul 06 15:36:34 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-81a82e16-36c5-4c27-b3b1-159cd46168ea tempest-CinderUnicodeTest-236720936 None] Lock "cinder-fd9303ea-5c7a-416f-a76c-c602bd07aade-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:35 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 1073741824" returned: 0 in 1.049s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:35 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2
Jul 06 15:36:35 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:36 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" returned: 0 in 0.673s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:36:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f16083d-518d-47e5-8696-02b54f2bccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9406925-7287-4966-8b71-05f2e0b44d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:36 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Volume volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 (5a2f0cea-2e9e-45ea-a2a6-5469180956c2): created successfully
Jul 06 15:36:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9406925-7287-4966-8b71-05f2e0b44d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Flow 'volume_create_manager' (2869da87-6447-4faf-a599-a4160ca2cf1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a891e1b3-af4a-4434-b819-862ad7759567 tempest-VolumesSnapshotTestJSON-832965738 None] Created volume successfully.
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Flow 'volume_create_manager' (1177da81-31a3-4f41-865f-e3666534cd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52c7caf-aea9-4261-9567-48a3f7bedaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52c7caf-aea9-4261-9567-48a3f7bedaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892426545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220179a4-2cc4-49e7-a5da-90ade94eefae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a9c7f9de4f46d486388f9f58785775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:38Z,use_quota=True,user_id='f7d834c2af414be183172305da6ec33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22368dc2-dedd-4306-bda1-19f9633a1714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22368dc2-dedd-4306-bda1-19f9633a1714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3a5e8f-bdfe-40c5-8342-d8f67d248a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3a5e8f-bdfe-40c5-8342-d8f67d248a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '220179a4-2cc4-49e7-a5da-90ade94eefae', 'volume_name': 'volume-220179a4-2cc4-49e7-a5da-90ade94eefae', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b71d19-1544-4bda-ad6d-328f4e4b8aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b71d19-1544-4bda-ad6d-328f4e4b8aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf328f90-b85c-4062-a660-51cacce2fab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:37 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Volume 220179a4-2cc4-49e7-a5da-90ade94eefae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-220179a4-2cc4-49e7-a5da-90ade94eefae', 'volume_size': 1}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892426545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220179a4-2cc4-49e7-a5da-90ade94eefae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a9c7f9de4f46d486388f9f58785775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:38Z,use_quota=True,user_id='f7d834c2af414be183172305da6ec33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Creating volume 220179a4-2cc4-49e7-a5da-90ade94eefae {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:36:37 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:37 devstack sudo[97898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae 1073741824
Jul 06 15:36:37 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:38 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae 1073741824" returned: 0 in 0.967s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:38 devstack sudo[97903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae
Jul 06 15:36:38 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:39 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae" returned: 0 in 0.618s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.610s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf328f90-b85c-4062-a660-51cacce2fab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220179a4-2cc4-49e7-a5da-90ade94eefae', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a97b0b9-92e4-4c37-a94b-2c18e168f023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Creating offline snapshot 3629a16f-9e3a-4c34-b669-a4211ca5d983 of volume 5a2f0cea-2e9e-45ea-a2a6-5469180956c2 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:36:39 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Volume volume-220179a4-2cc4-49e7-a5da-90ade94eefae (220179a4-2cc4-49e7-a5da-90ade94eefae): created successfully
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a97b0b9-92e4-4c37-a94b-2c18e168f023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Flow 'volume_create_manager' (1177da81-31a3-4f41-865f-e3666534cd3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7908fe1-1df0-4e6f-9bcc-d504c2d9587e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:39 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a64abe99-84be-43e7-80e6-ec6ff1b395c1 tempest-ProjectReaderTests-1659723553 None] Created volume successfully.
Jul 06 15:36:39 devstack sudo[97907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2
Jul 06 15:36:39 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Acquiring lock "cinder-220179a4-2cc4-49e7-a5da-90ade94eefae-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Lock "cinder-220179a4-2cc4-49e7-a5da-90ade94eefae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Acquiring lock "cinder-quobyte-220179a4-2cc4-49e7-a5da-90ade94eefae" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Lock "cinder-quobyte-220179a4-2cc4-49e7-a5da-90ade94eefae" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:40 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5aff72-156e-485c-870d-be978f47be47]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:40 devstack sudo[97911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae
Jul 06 15:36:40 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:40 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" returned: 0 in 0.882s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:40 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983 1G
Jul 06 15:36:40 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:40 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae" returned: 0 in 0.790s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:40 devstack sudo[97939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae
Jul 06 15:36:40 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:41 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983 1G" returned: 0 in 0.861s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:41 devstack sudo[97947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983
Jul 06 15:36:41 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:41 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-220179a4-2cc4-49e7-a5da-90ade94eefae" returned: 0 in 0.676s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Lock "cinder-quobyte-220179a4-2cc4-49e7-a5da-90ade94eefae" released by "delete_volume" :: held 1.514s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Created reservations ['f8862810-5887-420e-a1b9-13d8ccbb3673', '15ec8014-e813-4db5-a14a-729e6a436074', '6426fa6d-7c34-44bc-b4aa-561f81dcc087', 'ea010738-2788-40c4-b679-6cb65299a4f3'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:41 devstack sudo[97950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:36:41 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:41 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983" returned: 0 in 0.669s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:41 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983 is being set with open permissions: ugo+rw
Jul 06 15:36:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:41 devstack sudo[97955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983
Jul 06 15:36:41 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:42 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.717s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:36:42 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Deleted volume successfully.
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a665612e-0528-44e3-8109-a3db32dbbbf5 tempest-ProjectReaderTests-1659723553 None] Lock "cinder-220179a4-2cc4-49e7-a5da-90ade94eefae-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:42 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983" returned: 0 in 0.689s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:36:42 devstack sudo[97959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.info
Jul 06 15:36:42 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Flow 'volume_create_manager' (73cbfa07-6a20-4185-b6ed-75ab2469dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5de4806-3f6f-43f2-833c-4f4a4c3ae400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5de4806-3f6f-43f2-833c-4f4a4c3ae400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620998359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40db4cd-c74a-41fa-991d-021fc45e129b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a9c7f9de4f46d486388f9f58785775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:43Z,use_quota=True,user_id='f7d834c2af414be183172305da6ec33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b57453d-caef-43bb-a04a-c5c0007dabde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b57453d-caef-43bb-a04a-c5c0007dabde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737a69fa-4fa0-4fc9-9667-cb5b3609ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737a69fa-4fa0-4fc9-9667-cb5b3609ae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd40db4cd-c74a-41fa-991d-021fc45e129b', 'volume_name': 'volume-d40db4cd-c74a-41fa-991d-021fc45e129b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ab47d3-7e70-497b-ab79-71eee99105ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ab47d3-7e70-497b-ab79-71eee99105ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af23ed69-cf53-41e8-9cbe-80a69be80a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:42 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Volume d40db4cd-c74a-41fa-991d-021fc45e129b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d40db4cd-c74a-41fa-991d-021fc45e129b', 'volume_size': 1}
Jul 06 15:36:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:43 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.info" returned: 0 in 0.665s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:43 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.info is being set with open permissions: ugo+rw
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:43 devstack sudo[97962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.info
Jul 06 15:36:43 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:43 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.info" returned: 0 in 0.639s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.520s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.230s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620998359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40db4cd-c74a-41fa-991d-021fc45e129b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a9c7f9de4f46d486388f9f58785775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:43Z,use_quota=True,user_id='f7d834c2af414be183172305da6ec33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Creating volume d40db4cd-c74a-41fa-991d-021fc45e129b {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:36:43 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:43 devstack sudo[97973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b 1073741824
Jul 06 15:36:43 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-0ed27fa2-795c-4018-987a-ff10615e6933 req-e1ecb71f-fdea-4217-be1c-9631bf9bff52 tempest-TestStampPattern-1993956774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:44 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-540b7ff0-75ac-4eaf-b135-ee1408263e6b tempest-VolumesSnapshotTestJSON-832965738 None] Create snapshot completed successfully
Jul 06 15:36:44 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b 1073741824" returned: 0 in 0.936s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:44 devstack sudo[97979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b
Jul 06 15:36:44 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-3629a16f-9e3a-4c34-b669-a4211ca5d983-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-3629a16f-9e3a-4c34-b669-a4211ca5d983-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-3629a16f-9e3a-4c34-b669-a4211ca5d983" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-3629a16f-9e3a-4c34-b669-a4211ca5d983" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Deleting offline snapshot 3629a16f-9e3a-4c34-b669-a4211ca5d983 of volume 5a2f0cea-2e9e-45ea-a2a6-5469180956c2 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] snapshot_file for this snap is: volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e6c7f9-8ac6-4f7a-97d2-9ad77833e969]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:45 devstack sudo[97981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983
Jul 06 15:36:45 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:45 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b" returned: 0 in 0.866s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-0ed27fa2-795c-4018-987a-ff10615e6933 req-e1ecb71f-fdea-4217-be1c-9631bf9bff52 tempest-TestStampPattern-1993956774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.816s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af23ed69-cf53-41e8-9cbe-80a69be80a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d40db4cd-c74a-41fa-991d-021fc45e129b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56842617-4ad7-41a8-a303-30542ef8c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b153a1-2365-4e2f-bfaa-6d360cfbb880]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-0ed27fa2-795c-4018-987a-ff10615e6933 req-e1ecb71f-fdea-4217-be1c-9631bf9bff52 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:45 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Volume volume-d40db4cd-c74a-41fa-991d-021fc45e129b (d40db4cd-c74a-41fa-991d-021fc45e129b): created successfully
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56842617-4ad7-41a8-a303-30542ef8c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Flow 'volume_create_manager' (73cbfa07-6a20-4185-b6ed-75ab2469dd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:45 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-90176efd-efcd-4406-acad-39decd2b846f tempest-ProjectReaderTests-1659723553 None] Created volume successfully.
Jul 06 15:36:45 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf
Jul 06 15:36:45 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:46 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983" returned: 0 in 0.947s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:36:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[2043397b-47c0-466f-94e1-dabb3fdeaea7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:46 devstack sudo[97991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2
Jul 06 15:36:46 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:46 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-0ed27fa2-795c-4018-987a-ff10615e6933 req-e1ecb71f-fdea-4217-be1c-9631bf9bff52 tempest-TestStampPattern-1993956774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" returned: 0 in 0.772s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-0ed27fa2-795c-4018-987a-ff10615e6933 req-e1ecb71f-fdea-4217-be1c-9631bf9bff52 tempest-TestStampPattern-1993956774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.817s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-0ed27fa2-795c-4018-987a-ff10615e6933 req-e1ecb71f-fdea-4217-be1c-9631bf9bff52 tempest-TestStampPattern-1993956774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '100fde28-7d95-49ae-ba99-834a5218dec0', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:36:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-0ed27fa2-795c-4018-987a-ff10615e6933 req-e1ecb71f-fdea-4217-be1c-9631bf9bff52 tempest-TestStampPattern-1993956774 None] attachment_update completed successfully.
Jul 06 15:36:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Acquiring lock "cinder-d40db4cd-c74a-41fa-991d-021fc45e129b-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Lock "cinder-d40db4cd-c74a-41fa-991d-021fc45e129b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Acquiring lock "cinder-quobyte-d40db4cd-c74a-41fa-991d-021fc45e129b" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:36:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Lock "cinder-quobyte-d40db4cd-c74a-41fa-991d-021fc45e129b" acquired by "delete_volume" :: waited 0.051s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:36:47 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eba17d4-37a3-487e-a9a7-02426e0ae898]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:47 devstack sudo[97995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b
Jul 06 15:36:47 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:47 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" returned: 0 in 0.881s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:47 devstack sudo[98066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983
Jul 06 15:36:47 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:47 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b" returned: 0 in 0.829s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:47 devstack sudo[98387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b
Jul 06 15:36:47 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:48 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983" returned: 0 in 0.817s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:48 devstack sudo[98392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983
Jul 06 15:36:48 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:48 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d40db4cd-c74a-41fa-991d-021fc45e129b" returned: 0 in 0.693s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Lock "cinder-quobyte-d40db4cd-c74a-41fa-991d-021fc45e129b" released by "delete_volume" :: held 1.570s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Created reservations ['394ecd9f-68e2-4b08-a635-a6b889adce7a', '6aab644d-d1d7-475a-b15a-d26668226422', 'a2c53abb-7cbe-4023-9a5c-b9bcb1544862', 'b1750c78-718e-4f50-b4a3-5ea40727dd2a'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:48 devstack sudo[98395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:36:48 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:48 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2.3629a16f-9e3a-4c34-b669-a4211ca5d983" returned: 0 in 0.644s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-3629a16f-9e3a-4c34-b669-a4211ca5d983" released by "_delete_snapshot" :: held 3.425s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" released by "delete_snapshot" :: held 3.458s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:48 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Created reservations ['80931c26-0211-4b09-b8c9-70d5027a6901', '066d8bbc-d9bf-4dbf-8230-888617ce958d', 'f5d2732f-9409-48f7-aa6d-7bda9af7118b', '08660b06-dc5c-4a6a-8d8c-69a719c29aca'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:36:49 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Delete snapshot completed successfully.
Jul 06 15:36:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9e48634c-1952-4d0b-ac08-fff47f8aa2d5 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-3629a16f-9e3a-4c34-b669-a4211ca5d983-delete_snapshot" released by "delete_snapshot" :: held 3.666s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:49 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.674s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:49 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:36:49 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Deleted volume successfully.
Jul 06 15:36:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2d8436bb-1edf-481b-902d-725fbcdf38b7 tempest-ProjectReaderTests-1659723553 None] Lock "cinder-d40db4cd-c74a-41fa-991d-021fc45e129b-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Flow 'volume_create_manager' (75acb353-6c25-4fff-887d-41dfb23c7daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eec678a-f0ad-446e-a1f8-1c8c280694d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eec678a-f0ad-446e-a1f8-1c8c280694d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-204875896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5940cdc1fe8c4ded82be2498e1aa4582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:50Z,use_quota=True,user_id='f6d504c73ca14f209ec8b8bc2e482ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644c8a6b-6ce3-47e9-a80c-86357ecc8f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644c8a6b-6ce3-47e9-a80c-86357ecc8f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152b84dc-e477-4de8-adb9-eae09c5ad890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152b84dc-e477-4de8-adb9-eae09c5ad890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e', 'volume_name': 'volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fa6a8b-8f7a-40fd-9695-e86d7eea6eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fa6a8b-8f7a-40fd-9695-e86d7eea6eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe07b06-5218-4f6e-8d23-7876ca3ec6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:50 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Volume ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e', 'volume_size': 1}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-204875896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5940cdc1fe8c4ded82be2498e1aa4582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:50Z,use_quota=True,user_id='f6d504c73ca14f209ec8b8bc2e482ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Creating volume ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:36:50 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:36:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:50 devstack sudo[98400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e 1073741824
Jul 06 15:36:50 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Flow 'volume_create_manager' (4df8fba6-96dd-45e0-b0d7-d1e84f4ed3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:51 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2318d9a0-5300-4d8b-aeba-3d17c933d682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e 1073741824" returned: 0 in 1.040s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2318d9a0-5300-4d8b-aeba-3d17c933d682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-452502837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f810096-4926-48ed-a121-c91487abe028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb953ebe2d704ddbbb76386a23665f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:51Z,use_quota=True,user_id='a6844e2faead4b5493e349bfae34b5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099b8622-7281-4323-9785-92fae37b502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099b8622-7281-4323-9785-92fae37b502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44692348-3960-48d5-b9b9-699a78386562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44692348-3960-48d5-b9b9-699a78386562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f810096-4926-48ed-a121-c91487abe028', 'volume_name': 'volume-8f810096-4926-48ed-a121-c91487abe028', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9488b93f-42b5-44a5-b921-4091212de5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9488b93f-42b5-44a5-b921-4091212de5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314b91b6-2981-40e0-9d48-0f440a37ce08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:51 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Volume 8f810096-4926-48ed-a121-c91487abe028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f810096-4926-48ed-a121-c91487abe028', 'volume_size': 1}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:51 devstack sudo[98413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e
Jul 06 15:36:51 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:52 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" returned: 0 in 0.683s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.714s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-452502837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f810096-4926-48ed-a121-c91487abe028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb953ebe2d704ddbbb76386a23665f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:51Z,use_quota=True,user_id='a6844e2faead4b5493e349bfae34b5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Creating volume 8f810096-4926-48ed-a121-c91487abe028 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:36:52 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe07b06-5218-4f6e-8d23-7876ca3ec6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b6b65a-77dc-4648-80d3-2b24b7b9e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:52 devstack sudo[98420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028 1073741824
Jul 06 15:36:52 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Volume volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e (ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e): created successfully
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b6b65a-77dc-4648-80d3-2b24b7b9e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Flow 'volume_create_manager' (75acb353-6c25-4fff-887d-41dfb23c7daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:52 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b2c885eb-a6aa-4c87-b6de-647a5089ccd8 tempest-VolumesSnapshotTestJSON-832965738 None] Created volume successfully.
Jul 06 15:36:53 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028 1073741824" returned: 0 in 1.030s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:53 devstack sudo[98427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028
Jul 06 15:36:53 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:53 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028" returned: 0 in 0.756s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.376s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Creating offline snapshot c12c295e-cd42-411c-8067-fb0862b913d5 of volume ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314b91b6-2981-40e0-9d48-0f440a37ce08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f810096-4926-48ed-a121-c91487abe028', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3759db3-b4e6-4d9f-a3da-5a9558b8468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b121ba-55e7-4cd0-bdf5-bc879adfdb8c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:53 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Volume volume-8f810096-4926-48ed-a121-c91487abe028 (8f810096-4926-48ed-a121-c91487abe028): created successfully
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3759db3-b4e6-4d9f-a3da-5a9558b8468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Flow 'volume_create_manager' (4df8fba6-96dd-45e0-b0d7-d1e84f4ed3fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:54 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b11b0587-5da1-41df-b360-3bcfbd3b6208 tempest-AttachVolumeNegativeTest-2009578222 None] Created volume successfully.
Jul 06 15:36:54 devstack sudo[98435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e
Jul 06 15:36:54 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:54 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" returned: 0 in 0.902s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:54 devstack sudo[98450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 1G
Jul 06 15:36:54 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:55 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 1G" returned: 0 in 0.905s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:55 devstack sudo[98457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5
Jul 06 15:36:55 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:56 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-24cc481f-722b-4963-b236-0ed09af352f9 req-34c3d8db-10e8-49d0-b4d0-ed2e1ba2da25 tempest-TestStampPattern-1993956774 None] Terminate volume connection completed successfully.
Jul 06 15:36:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-24cc481f-722b-4963-b236-0ed09af352f9 req-34c3d8db-10e8-49d0-b4d0-ed2e1ba2da25 tempest-TestStampPattern-1993956774 None] Deleting attachment 100fde28-7d95-49ae-ba99-834a5218dec0. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:36:56 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5" returned: 0 in 0.734s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:56 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 is being set with open permissions: ugo+rw
Jul 06 15:36:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:56 devstack sudo[98491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5
Jul 06 15:36:56 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:57 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5" returned: 0 in 0.720s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:57 devstack sudo[98494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.info
Jul 06 15:36:57 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-2f0d4ec9-1456-4d30-bcd5-c4f02d67c0cf req-ef34e3f6-b665-470a-9044-fdf0074b348a tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:57 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.info" returned: 0 in 0.711s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:57 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.info is being set with open permissions: ugo+rw
Jul 06 15:36:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:58 devstack sudo[98506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.info
Jul 06 15:36:58 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Flow 'volume_create_manager' (105a7d78-491e-4d6a-b4ab-57cb6d13b1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459901f0-edec-47d4-a53b-ea61a9e62e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459901f0-edec-47d4-a53b-ea61a9e62e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127181487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b7f3af-a4d0-4e29-97ee-ee625119844e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729645c918524a839a831e86f29dd5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:58Z,use_quota=True,user_id='e958f17197d847d4b4c37932127f85a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451c9ce5-5d09-4eb1-ade8-201f712e68f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451c9ce5-5d09-4eb1-ade8-201f712e68f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d423ab-dc31-4ceb-b8a1-246fd3ba3064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d423ab-dc31-4ceb-b8a1-246fd3ba3064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b7f3af-a4d0-4e29-97ee-ee625119844e', 'volume_name': 'volume-50b7f3af-a4d0-4e29-97ee-ee625119844e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcc8e9c-213b-4077-8a9d-655e053b0e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcc8e9c-213b-4077-8a9d-655e053b0e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6606b6-4dad-4f24-bf2d-b8f8ee4377ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:58 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Volume 50b7f3af-a4d0-4e29-97ee-ee625119844e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b7f3af-a4d0-4e29-97ee-ee625119844e', 'volume_size': 1}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:58 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.info" returned: 0 in 0.656s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.745s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-2f0d4ec9-1456-4d30-bcd5-c4f02d67c0cf req-ef34e3f6-b665-470a-9044-fdf0074b348a tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.051s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e48801-5037-4756-987e-4f760d3d74c9]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:36:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-2f0d4ec9-1456-4d30-bcd5-c4f02d67c0cf req-ef34e3f6-b665-470a-9044-fdf0074b348a tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:58 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-240fabc6-691d-424e-bb9c-f5aef978f07e tempest-VolumesSnapshotTestJSON-832965738 None] Create snapshot completed successfully
Jul 06 15:36:58 devstack sudo[98509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028
Jul 06 15:36:58 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:59 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-2f0d4ec9-1456-4d30-bcd5-c4f02d67c0cf req-ef34e3f6-b665-470a-9044-fdf0074b348a tempest-AttachVolumeNegativeTest-2009578222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028" returned: 0 in 0.826s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-2f0d4ec9-1456-4d30-bcd5-c4f02d67c0cf req-ef34e3f6-b665-470a-9044-fdf0074b348a tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127181487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b7f3af-a4d0-4e29-97ee-ee625119844e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729645c918524a839a831e86f29dd5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:58Z,use_quota=True,user_id='e958f17197d847d4b4c37932127f85a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Creating volume 50b7f3af-a4d0-4e29-97ee-ee625119844e {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:36:59 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:36:59 devstack sudo[98514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e 1073741824
Jul 06 15:36:59 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-2f0d4ec9-1456-4d30-bcd5-c4f02d67c0cf req-ef34e3f6-b665-470a-9044-fdf0074b348a tempest-AttachVolumeNegativeTest-2009578222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-8f810096-4926-48ed-a121-c91487abe028', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f37f4ec-bad0-400e-a7d8-3dcf9b0b9676', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Flow 'volume_create_manager' (e428c454-2173-4c92-9485-cbc5bdccef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59463e68-b3ef-46d5-a351-0fe9cb5c8b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59463e68-b3ef-46d5-a351-0fe9cb5c8b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2025306434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243b6441-5809-4b90-b995-e5c401870291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5940cdc1fe8c4ded82be2498e1aa4582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c12c295e-cd42-411c-8067-fb0862b913d5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:00Z,use_quota=True,user_id='f6d504c73ca14f209ec8b8bc2e482ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeb6596-076f-4e9e-878a-7d78604560e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeb6596-076f-4e9e-878a-7d78604560e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e734ba0a-af03-407e-9660-60f5afe99145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e734ba0a-af03-407e-9660-60f5afe99145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '243b6441-5809-4b90-b995-e5c401870291', 'volume_name': 'volume-243b6441-5809-4b90-b995-e5c401870291', 'volume_size': 2, 'snapshot_id': 'c12c295e-cd42-411c-8067-fb0862b913d5'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff150af-421a-4e9b-ac49-4a2065c8fbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff150af-421a-4e9b-ac49-4a2065c8fbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34874955-969d-4fca-8c64-e1bb071305c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:36:59 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Volume 243b6441-5809-4b90-b995-e5c401870291: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-243b6441-5809-4b90-b995-e5c401870291', 'volume_size': 2, 'snapshot_id': 'c12c295e-cd42-411c-8067-fb0862b913d5'}
Jul 06 15:36:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:36:59 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-2f0d4ec9-1456-4d30-bcd5-c4f02d67c0cf req-ef34e3f6-b665-470a-9044-fdf0074b348a tempest-AttachVolumeNegativeTest-2009578222 None] attachment_update completed successfully.
Jul 06 15:37:00 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e 1073741824" returned: 0 in 0.833s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:00 devstack sudo[98588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e
Jul 06 15:37:00 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:01 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e" returned: 0 in 0.652s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.765s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Creating offline snapshot 93a995a3-f933-4c03-9654-e19a000e89ea of volume 2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6606b6-4dad-4f24-bf2d-b8f8ee4377ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b7f3af-a4d0-4e29-97ee-ee625119844e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18448789-e600-441d-a11b-6fac789f3e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec607451-b68a-4e8a-8a7e-3b94bd935ca8]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:01 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Volume volume-50b7f3af-a4d0-4e29-97ee-ee625119844e (50b7f3af-a4d0-4e29-97ee-ee625119844e): created successfully
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18448789-e600-441d-a11b-6fac789f3e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Flow 'volume_create_manager' (105a7d78-491e-4d6a-b4ab-57cb6d13b1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:01 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-cd0d8a42-d081-4c93-ac1a-8e465926a442 tempest-ProjectReaderTests-2024003838 None] Created volume successfully.
Jul 06 15:37:01 devstack sudo[98906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf
Jul 06 15:37:01 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Acquiring lock "cinder-50b7f3af-a4d0-4e29-97ee-ee625119844e-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Lock "cinder-50b7f3af-a4d0-4e29-97ee-ee625119844e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Acquiring lock "cinder-quobyte-50b7f3af-a4d0-4e29-97ee-ee625119844e" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Lock "cinder-quobyte-50b7f3af-a4d0-4e29-97ee-ee625119844e" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:01 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" returned: 0 in 0.819s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94b57f1-5bad-4a8f-9d3f-212b7caf4e43]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:01 devstack sudo[98911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea 1G
Jul 06 15:37:01 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:02 devstack sudo[98912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e
Jul 06 15:37:02 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:02 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e" returned: 0 in 0.771s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:02 devstack sudo[98921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e
Jul 06 15:37:02 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:02 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea 1G" returned: 0 in 0.856s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:02 devstack sudo[98923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea
Jul 06 15:37:02 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:03 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-50b7f3af-a4d0-4e29-97ee-ee625119844e" returned: 0 in 0.638s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Lock "cinder-quobyte-50b7f3af-a4d0-4e29-97ee-ee625119844e" released by "delete_volume" :: held 1.462s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Created reservations ['27449722-2f07-4de8-94c2-82d049656451', '2a7ca5bb-7c21-428d-a0b4-097c6b4a92cd', 'f614aee0-1be8-4baf-a8f9-d1f5c849e951', 'a7fca39c-69aa-4b44-a38e-3fca230b570b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:03 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea" returned: 0 in 0.718s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:03 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea is being set with open permissions: ugo+rw
Jul 06 15:37:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:03 devstack sudo[98929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:03 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:03 devstack sudo[98930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea
Jul 06 15:37:03 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:04 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.706s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Deleted volume successfully.
Jul 06 15:37:04 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea" returned: 0 in 0.741s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0464af01-e3fa-42a5-ac18-cc903ce0c3c8 tempest-ProjectReaderTests-2024003838 None] Lock "cinder-50b7f3af-a4d0-4e29-97ee-ee625119844e-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:04 devstack sudo[98935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.info
Jul 06 15:37:04 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Flow 'volume_create_manager' (694c8c7e-870d-4dae-854d-ffc46667ea7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d481e8d8-cf00-4c6d-bdb4-0924c561617a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d481e8d8-cf00-4c6d-bdb4-0924c561617a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-680474793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dee62f-846c-45b6-a3a5-71decc69978f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729645c918524a839a831e86f29dd5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:05Z,use_quota=True,user_id='e958f17197d847d4b4c37932127f85a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3065415-37bc-4f2b-a1bc-bd2002206358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3065415-37bc-4f2b-a1bc-bd2002206358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b372b8-ad85-46f3-ad4a-8fcb11b567bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b372b8-ad85-46f3-ad4a-8fcb11b567bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17dee62f-846c-45b6-a3a5-71decc69978f', 'volume_name': 'volume-17dee62f-846c-45b6-a3a5-71decc69978f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712256ba-2503-4b65-ab5c-6d5e8f4ca37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712256ba-2503-4b65-ab5c-6d5e8f4ca37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d65ea9-57a4-4243-848b-53ceda2b71ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:04 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Volume 17dee62f-846c-45b6-a3a5-71decc69978f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17dee62f-846c-45b6-a3a5-71decc69978f', 'volume_size': 1}
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:04 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.info" returned: 0 in 0.655s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:04 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.info is being set with open permissions: ugo+rw
Jul 06 15:37:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:04 devstack sudo[98938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.info
Jul 06 15:37:04 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:05 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.info" returned: 0 in 0.651s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.580s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.936s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-c12c295e-cd42-411c-8067-fb0862b913d5-243b6441-5809-4b90-b995-e5c401870291" by "_create_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:05 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fb07ad2c-f0c7-4b6d-a2b6-ce68b58f2623 tempest-TestStampPattern-1993956774 None] Create snapshot completed successfully
Jul 06 15:37:05 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-4078485a-c282-436d-a802-e18824dec04a req-c0d16d2f-4520-49db-9948-e1b591694efb tempest-AttachVolumeNegativeTest-2009578222 None] Terminate volume connection completed successfully.
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-4078485a-c282-436d-a802-e18824dec04a req-c0d16d2f-4520-49db-9948-e1b591694efb tempest-AttachVolumeNegativeTest-2009578222 None] Deleting attachment 2f37f4ec-bad0-400e-a7d8-3dcf9b0b9676. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-c12c295e-cd42-411c-8067-fb0862b913d5-243b6441-5809-4b90-b995-e5c401870291" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Creating volume 243b6441-5809-4b90-b995-e5c401870291 from snapshot c12c295e-cd42-411c-8067-fb0862b913d5 {{(pid=86249) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-243b6441-5809-4b90-b995-e5c401870291" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-243b6441-5809-4b90-b995-e5c401870291" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] snapshot: c12c295e-cd42-411c-8067-fb0862b913d5, volume: 243b6441-5809-4b90-b995-e5c401870291,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f64c85-55d4-49c7-8e75-87fe5859be21]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:05 devstack sudo[98968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5
Jul 06 15:37:05 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:06 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5" returned: 0 in 0.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8853cae4-5243-48e3-bcee-5cd0d73eb91d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:06 devstack sudo[98975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:06 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:06 devstack sudo[98974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e
Jul 06 15:37:06 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:07 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.697s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:37:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:37:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:37:07 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" returned: 0 in 0.827s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:07 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291 not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:37:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:07 devstack sudo[98983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291
Jul 06 15:37:07 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:13 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291" returned: 0 in 6.077s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:13 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe7587-e7d5-47c0-acd4-c317acb22114]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:13 devstack sudo[99093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e
Jul 06 15:37:13 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:14 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" returned: 0 in 1.000s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:14 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:37:14 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Converted 1024.00 MB image at 168.48 MB/s
Jul 06 15:37:14 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291 is being set with open permissions: ugo+rw
Jul 06 15:37:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:14 devstack sudo[99098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291
Jul 06 15:37:14 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:15 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291" returned: 0 in 0.678s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-243b6441-5809-4b90-b995-e5c401870291" released by "_copy_volume_from_snapshot" :: held 9.519s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-c12c295e-cd42-411c-8067-fb0862b913d5-243b6441-5809-4b90-b995-e5c401870291" released by "_create_volume_from_snapshot" :: held 9.560s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.600s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.558s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-680474793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dee62f-846c-45b6-a3a5-71decc69978f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729645c918524a839a831e86f29dd5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:05Z,use_quota=True,user_id='e958f17197d847d4b4c37932127f85a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Creating volume 17dee62f-846c-45b6-a3a5-71decc69978f {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:37:15 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:15 devstack sudo[99101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f 1073741824
Jul 06 15:37:15 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34874955-969d-4fca-8c64-e1bb071305c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243b6441-5809-4b90-b995-e5c401870291', 'volume_size': 2, 'snapshot_id': 'c12c295e-cd42-411c-8067-fb0862b913d5'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ba40e2-9e34-47bd-9d02-ead4207b25e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:15 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Volume volume-243b6441-5809-4b90-b995-e5c401870291 (243b6441-5809-4b90-b995-e5c401870291): created successfully
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ba40e2-9e34-47bd-9d02-ead4207b25e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Flow 'volume_create_manager' (e428c454-2173-4c92-9485-cbc5bdccef29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bd72c6a5-6537-4c78-b63e-48203d1e1522 tempest-VolumesSnapshotTestJSON-832965738 None] Created volume successfully.
Jul 06 15:37:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-243b6441-5809-4b90-b995-e5c401870291-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-243b6441-5809-4b90-b995-e5c401870291-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-243b6441-5809-4b90-b995-e5c401870291" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-243b6441-5809-4b90-b995-e5c401870291" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:16 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3663ba94-3463-4a71-98f5-a7ef24014907]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:16 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f 1073741824" returned: 0 in 1.015s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:16 devstack sudo[99109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291
Jul 06 15:37:16 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:16 devstack sudo[99111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f
Jul 06 15:37:16 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:17 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:17 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291" returned: 0 in 0.934s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f" returned: 0 in 0.823s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:17 devstack sudo[99117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291
Jul 06 15:37:17 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d65ea9-57a4-4243-848b-53ceda2b71ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17dee62f-846c-45b6-a3a5-71decc69978f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50757fcc-dc56-43d2-91e3-6e09d45806ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:17 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Volume volume-17dee62f-846c-45b6-a3a5-71decc69978f (17dee62f-846c-45b6-a3a5-71decc69978f): created successfully
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50757fcc-dc56-43d2-91e3-6e09d45806ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Flow 'volume_create_manager' (694c8c7e-870d-4dae-854d-ffc46667ea7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Flow 'volume_create_manager' (3f0b61d5-f961-452c-86ea-f5198c3a1300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea3479f-fb56-4e9d-8448-cb50a66e33d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea3479f-fb56-4e9d-8448-cb50a66e33d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1244005082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1c922b-1619-4992-afa7-884c0ac641e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42984dec38e54c7d976012e74a52c90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93a995a3-f933-4c03-9654-e19a000e89ea,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:17Z,use_quota=True,user_id='4b0b883b806142918492dd97209134d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee5e160-c5cf-48d5-8cad-a26704891606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee5e160-c5cf-48d5-8cad-a26704891606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a2edfb-522c-40fc-a7cc-4df66e9422a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a2edfb-522c-40fc-a7cc-4df66e9422a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a1c922b-1619-4992-afa7-884c0ac641e0', 'volume_name': 'volume-1a1c922b-1619-4992-afa7-884c0ac641e0', 'volume_size': 1, 'snapshot_id': '93a995a3-f933-4c03-9654-e19a000e89ea'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b80db13-5b5f-4cb3-8152-6adf6c92e3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b80db13-5b5f-4cb3-8152-6adf6c92e3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9825d63-4f09-4e69-bcd5-60f583d785d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:17 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Volume 1a1c922b-1619-4992-afa7-884c0ac641e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a1c922b-1619-4992-afa7-884c0ac641e0', 'volume_size': 1, 'snapshot_id': '93a995a3-f933-4c03-9654-e19a000e89ea'}
Jul 06 15:37:17 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7c4aa774-5b91-4472-beae-14eb84d7a95a tempest-ProjectReaderTests-2024003838 None] Created volume successfully.
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Acquiring lock "cinder-quobyte-93a995a3-f933-4c03-9654-e19a000e89ea-1a1c922b-1619-4992-afa7-884c0ac641e0" by "_create_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-93a995a3-f933-4c03-9654-e19a000e89ea-1a1c922b-1619-4992-afa7-884c0ac641e0" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Creating volume 1a1c922b-1619-4992-afa7-884c0ac641e0 from snapshot 93a995a3-f933-4c03-9654-e19a000e89ea {{(pid=86249) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Acquiring lock "cinder-quobyte-1a1c922b-1619-4992-afa7-884c0ac641e0" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-1a1c922b-1619-4992-afa7-884c0ac641e0" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] snapshot: 93a995a3-f933-4c03-9654-e19a000e89ea, volume: 1a1c922b-1619-4992-afa7-884c0ac641e0,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5985f9a7-4a8f-44c4-8fa7-3567658e0d18]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:17 devstack sudo[99119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea
Jul 06 15:37:17 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Acquiring lock "cinder-17dee62f-846c-45b6-a3a5-71decc69978f-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:18 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Lock "cinder-17dee62f-846c-45b6-a3a5-71decc69978f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-243b6441-5809-4b90-b995-e5c401870291" returned: 0 in 0.928s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-243b6441-5809-4b90-b995-e5c401870291" released by "delete_volume" :: held 1.954s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Acquiring lock "cinder-quobyte-17dee62f-846c-45b6-a3a5-71decc69978f" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Lock "cinder-quobyte-17dee62f-846c-45b6-a3a5-71decc69978f" acquired by "delete_volume" :: waited 0.029s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b2c176-8b88-4c15-a0d8-87698e3261b1]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Created reservations ['317d6d93-42b6-413c-95d4-b78a3c5c8647', '009cd7bf-b5fe-4e43-bab1-7ffa70671394', '78960f46-351b-4d3b-8f08-bd7037c89c78', '70255a72-3b62-4a80-983a-06bc62875c83'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "cinder-8f810096-4926-48ed-a121-c91487abe028-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-8f810096-4926-48ed-a121-c91487abe028-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:18 devstack sudo[99123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f
Jul 06 15:37:18 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:18 devstack sudo[99126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:18 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "cinder-quobyte-8f810096-4926-48ed-a121-c91487abe028" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-quobyte-8f810096-4926-48ed-a121-c91487abe028" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[594a3014-bf3b-4a19-bf8c-ed551ab7cf1e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:18 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea" returned: 0 in 1.157s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f4056e-8866-4e77-9a01-11e0f169eecd]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:18 devstack sudo[99132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028
Jul 06 15:37:18 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:18 devstack sudo[99134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf
Jul 06 15:37:18 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:19 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.795s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:19 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Deleted volume successfully.
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fcf98bc6-2250-4fbc-b5b2-8f38881a81bd tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-243b6441-5809-4b90-b995-e5c401870291-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:19 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f" returned: 0 in 1.166s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:19 devstack sudo[99144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f
Jul 06 15:37:19 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-c12c295e-cd42-411c-8067-fb0862b913d5-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:19 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028" returned: 0 in 0.978s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-c12c295e-cd42-411c-8067-fb0862b913d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-c12c295e-cd42-411c-8067-fb0862b913d5" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:19 devstack sudo[99148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028
Jul 06 15:37:19 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-c12c295e-cd42-411c-8067-fb0862b913d5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Deleting offline snapshot c12c295e-cd42-411c-8067-fb0862b913d5 of volume ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] snapshot_file for this snap is: volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ad2083-6828-45da-b402-0c666cb478b0]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:19 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" returned: 0 in 1.039s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0 not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:37:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:19 devstack sudo[99152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0
Jul 06 15:37:19 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:19 devstack sudo[99151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5
Jul 06 15:37:19 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:20 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-17dee62f-846c-45b6-a3a5-71decc69978f" returned: 0 in 0.873s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Lock "cinder-quobyte-17dee62f-846c-45b6-a3a5-71decc69978f" released by "delete_volume" :: held 2.107s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:20 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-8f810096-4926-48ed-a121-c91487abe028" returned: 0 in 0.799s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-quobyte-8f810096-4926-48ed-a121-c91487abe028" released by "delete_volume" :: held 1.850s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Created reservations ['bb328def-eb07-4480-ba07-33a02d849f87', '03713702-e700-49a1-9bca-fd290fa3a151', '5dd68d95-564b-4aa7-b774-2b941dd32968', '708b0b46-1576-4e0c-8091-ee6f08abe7cf'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Created reservations ['264f166f-b90f-4f20-8d2c-7eb8408f3613', '70db2025-f222-4fed-9b33-39768ec1134c', '3c35126c-8ab2-40d6-b5ec-3ef5185f464b', 'ca8873cc-2ecd-459c-a29e-edc381d9253e'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:20 devstack sudo[99163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:20 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:20 devstack sudo[99167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:20 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:20 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5" returned: 0 in 0.987s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b6c5e-1bd3-41e8-954c-21935ac85e1f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "cinder-75a1dc16-4455-41fb-b518-e0adacad1f2e-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-75a1dc16-4455-41fb-b518-e0adacad1f2e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:20 devstack sudo[99169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e
Jul 06 15:37:20 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "cinder-quobyte-75a1dc16-4455-41fb-b518-e0adacad1f2e" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-quobyte-75a1dc16-4455-41fb-b518-e0adacad1f2e" acquired by "delete_volume" :: waited 0.034s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:21 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd40e36-8e31-416c-a84c-456597bac361]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:21 devstack sudo[99177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e
Jul 06 15:37:21 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:22 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 2.019s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:22 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Deleted volume successfully.
Jul 06 15:37:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bbd3882a-29f9-4393-ade5-08178024b01a tempest-ProjectReaderTests-2024003838 None] Lock "cinder-17dee62f-846c-45b6-a3a5-71decc69978f-delete_volume" released by "delete_volume" :: held 4.604s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:22 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 2.369s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:22 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Deleted volume successfully.
Jul 06 15:37:22 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" returned: 0 in 2.279s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-027c3e23-b241-48a4-b434-19532b7391e3 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-8f810096-4926-48ed-a121-c91487abe028-delete_volume" released by "delete_volume" :: held 4.709s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:23 devstack sudo[99185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5
Jul 06 15:37:23 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Flow 'volume_create_manager' (d8c09cb5-5c05-42bf-872c-35d977af95f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fb29db-aa7b-4f5a-a414-0b4e506b5a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fb29db-aa7b-4f5a-a414-0b4e506b5a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-140397006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56403c99-7692-4182-bf9f-f176c4865299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729645c918524a839a831e86f29dd5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:23Z,use_quota=True,user_id='e958f17197d847d4b4c37932127f85a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76e5585-61ca-4d64-ab49-2f848bea6c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76e5585-61ca-4d64-ab49-2f848bea6c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7d4f10-1c72-47d0-8b7c-1b947f7a03fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7d4f10-1c72-47d0-8b7c-1b947f7a03fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56403c99-7692-4182-bf9f-f176c4865299', 'volume_name': 'volume-56403c99-7692-4182-bf9f-f176c4865299', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa6a13a-3a40-4846-84bc-49f3cab3e3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa6a13a-3a40-4846-84bc-49f3cab3e3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd4763b-1c20-42e4-bbee-fe35d97f827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:23 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Volume 56403c99-7692-4182-bf9f-f176c4865299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56403c99-7692-4182-bf9f-f176c4865299', 'volume_size': 1}
Jul 06 15:37:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:24 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e" returned: 0 in 2.903s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:24 devstack sudo[99195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e
Jul 06 15:37:24 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:25 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5" returned: 0 in 2.699s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:25 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5
Jul 06 15:37:25 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:26 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-75a1dc16-4455-41fb-b518-e0adacad1f2e" returned: 0 in 2.700s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-quobyte-75a1dc16-4455-41fb-b518-e0adacad1f2e" released by "delete_volume" :: held 5.697s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:26 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=106,cinder:INSERT=24,cinder:UPDATE=94,cinder:DELETE=8 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:37:26 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Created reservations ['7e0379b9-2216-43a8-8666-3cc99151d3c7', '9e0b9e0d-ec52-4e5a-8ba1-5f05350aa4dc', '7121ffbc-b100-4075-b531-1b761971b7ba', '73cfbc5d-a272-4b5a-8738-683fd6df8e02'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:26 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=99,cinder:INSERT=30,cinder:UPDATE=123,cinder:DELETE=11 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:27 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:27 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0" returned: 0 in 7.505s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[121eeb49-e30c-4c00-8a85-9d3b3ac06fca]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:27 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf
Jul 06 15:37:27 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:27 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e.c12c295e-cd42-411c-8067-fb0862b913d5" returned: 0 in 1.758s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-c12c295e-cd42-411c-8067-fb0862b913d5" released by "_delete_snapshot" :: held 7.911s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" released by "delete_snapshot" :: held 7.943s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Created reservations ['b3b72aa6-4985-4a33-927d-476a0e184085', '9ef387bb-da5d-46a8-875f-fdb3637fb82f', '3586a771-1420-4019-8760-f732bfc158e9', 'b07530b2-079b-4166-9981-e4faaf9bcf39'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Delete snapshot completed successfully.
Jul 06 15:37:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-22617e6c-2885-40f0-92ea-f18fe1df9580 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-c12c295e-cd42-411c-8067-fb0862b913d5-delete_snapshot" released by "delete_snapshot" :: held 8.166s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:28 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.947s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:28 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Deleted volume successfully.
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a40b5977-a8e7-45c0-8530-e9e6d02ed18c tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-75a1dc16-4455-41fb-b518-e0adacad1f2e-delete_volume" released by "delete_volume" :: held 7.241s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" acquired by "delete_volume" :: waited 0.035s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "cinder-c43a67cf-72be-4d09-b1fd-ac87cb17bfef-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c99abae-8330-48eb-855e-eeb222393159]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-c43a67cf-72be-4d09-b1fd-ac87cb17bfef-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "cinder-quobyte-c43a67cf-72be-4d09-b1fd-ac87cb17bfef" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-quobyte-c43a67cf-72be-4d09-b1fd-ac87cb17bfef" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:28 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bb26b0-f31f-4031-8200-0d3cebf5933a]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" returned: 0 in 1.518s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf, size 1024.00 MB, duration 7.51 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:37:28 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Converted 1024.00 MB image at 136.42 MB/s
Jul 06 15:37:28 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0 is being set with open permissions: ugo+rw
Jul 06 15:37:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:28 devstack sudo[99214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0
Jul 06 15:37:28 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:28 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e
Jul 06 15:37:28 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:28 devstack sudo[99213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef
Jul 06 15:37:28 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:29 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0" returned: 0 in 0.850s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-1a1c922b-1619-4992-afa7-884c0ac641e0" released by "_copy_volume_from_snapshot" :: held 12.211s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-93a995a3-f933-4c03-9654-e19a000e89ea-1a1c922b-1619-4992-afa7-884c0ac641e0" released by "_create_volume_from_snapshot" :: held 12.261s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.282s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.665s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-140397006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56403c99-7692-4182-bf9f-f176c4865299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729645c918524a839a831e86f29dd5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:23Z,use_quota=True,user_id='e958f17197d847d4b4c37932127f85a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Creating volume 56403c99-7692-4182-bf9f-f176c4865299 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:29 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:37:29 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef" returned: 0 in 0.950s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:29 devstack sudo[99242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299 1073741824
Jul 06 15:37:29 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:29 devstack sudo[99243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef
Jul 06 15:37:29 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9825d63-4f09-4e69-bcd5-60f583d785d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1c922b-1619-4992-afa7-884c0ac641e0', 'volume_size': 1, 'snapshot_id': '93a995a3-f933-4c03-9654-e19a000e89ea'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:29 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6775fd-6b43-4788-ab9b-305c722d9ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" returned: 0 in 1.190s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:29 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Volume volume-1a1c922b-1619-4992-afa7-884c0ac641e0 (1a1c922b-1619-4992-afa7-884c0ac641e0): created successfully
Jul 06 15:37:29 devstack sudo[99248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e
Jul 06 15:37:29 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6775fd-6b43-4788-ab9b-305c722d9ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Flow 'volume_create_manager' (3f0b61d5-f961-452c-86ea-f5198c3a1300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:29 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-933c883d-7351-489e-b589-d2b165ec9ec6 tempest-TestStampPattern-1993956774 None] Created volume successfully.
Jul 06 15:37:30 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c43a67cf-72be-4d09-b1fd-ac87cb17bfef" returned: 0 in 0.929s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-quobyte-c43a67cf-72be-4d09-b1fd-ac87cb17bfef" released by "delete_volume" :: held 1.928s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:30 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299 1073741824" returned: 0 in 0.994s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:30 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" returned: 0 in 0.912s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Created reservations ['c75f40ed-0f08-445f-a389-5beed22c4190', '610f2a9f-f4ef-4874-8e1b-263353c0adee', '9658bada-fdee-4618-a071-19ce5be40afc', 'f36c81f3-41dd-4357-b9c5-8261e47d33d8'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e" released by "delete_volume" :: held 2.229s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:30 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299
Jul 06 15:37:30 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:30 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Created reservations ['8a116023-cc1a-4e51-a43d-78440ec32c8c', '6063b1ce-a7cd-40b1-9272-23ab27356966', '915641bb-b7cc-40e5-854c-5b62618ee50b', '4309f57a-5a73-48ac-b8e3-66fce18531b7'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:30 devstack sudo[99270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:30 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:31 devstack sudo[99272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:31 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:31 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299" returned: 0 in 0.908s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd4763b-1c20-42e4-bbee-fe35d97f827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56403c99-7692-4182-bf9f-f176c4865299', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2fa40f-562a-43d1-a14b-329e7360c77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:31 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Volume volume-56403c99-7692-4182-bf9f-f176c4865299 (56403c99-7692-4182-bf9f-f176c4865299): created successfully
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2fa40f-562a-43d1-a14b-329e7360c77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Flow 'volume_create_manager' (d8c09cb5-5c05-42bf-872c-35d977af95f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:31 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.935s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Deleted volume successfully.
Jul 06 15:37:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-067ee057-3bb1-404c-a384-3e71c44245df tempest-ProjectReaderTests-2024003838 None] Created volume successfully.
Jul 06 15:37:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-42295984-c691-4ebd-bec6-520843d304e4 tempest-AttachVolumeNegativeTest-2009578222 None] Lock "cinder-c43a67cf-72be-4d09-b1fd-ac87cb17bfef-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Acquiring lock "cinder-56403c99-7692-4182-bf9f-f176c4865299-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Lock "cinder-56403c99-7692-4182-bf9f-f176c4865299-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:32 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.104s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Deleted volume successfully.
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Acquiring lock "cinder-quobyte-56403c99-7692-4182-bf9f-f176c4865299" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bda6ffd2-fc57-4141-bcf4-74442918da05 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-ae64e7fb-3709-4e8e-9f9d-54fcf63b0b2e-delete_volume" released by "delete_volume" :: held 3.769s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Lock "cinder-quobyte-56403c99-7692-4182-bf9f-f176c4865299" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f3e51b-7a53-47ab-ac88-e2a7c522b66f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:32 devstack sudo[99277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299
Jul 06 15:37:32 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Flow 'volume_create_manager' (61c2e455-4c62-4621-ba13-1c760396bfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2f25dc-5d31-4565-8b9d-d1000683cf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2f25dc-5d31-4565-8b9d-d1000683cf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-951819350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18584f66-106c-41c3-8be2-2d43e765fd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5940cdc1fe8c4ded82be2498e1aa4582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:33Z,use_quota=True,user_id='f6d504c73ca14f209ec8b8bc2e482ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd755b76-723c-45ba-b29c-d0293def44d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd755b76-723c-45ba-b29c-d0293def44d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca025be7-4297-4378-8e8b-549a8221a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca025be7-4297-4378-8e8b-549a8221a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18584f66-106c-41c3-8be2-2d43e765fd66', 'volume_name': 'volume-18584f66-106c-41c3-8be2-2d43e765fd66', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32dad09-3198-4ae5-ad90-242e59d93282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32dad09-3198-4ae5-ad90-242e59d93282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a8987f-d3a9-4c4c-b4c3-f369f0023d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:32 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Volume 18584f66-106c-41c3-8be2-2d43e765fd66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18584f66-106c-41c3-8be2-2d43e765fd66', 'volume_size': 1}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-951819350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18584f66-106c-41c3-8be2-2d43e765fd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5940cdc1fe8c4ded82be2498e1aa4582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:33Z,use_quota=True,user_id='f6d504c73ca14f209ec8b8bc2e482ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Creating volume 18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:37:32 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:37:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:32 devstack sudo[99279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 1073741824
Jul 06 15:37:32 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:33 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299" returned: 0 in 1.170s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:33 devstack sudo[99303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299
Jul 06 15:37:33 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:33 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 1073741824" returned: 0 in 1.110s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:33 devstack sudo[99311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66
Jul 06 15:37:33 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:34 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-56403c99-7692-4182-bf9f-f176c4865299" returned: 0 in 0.769s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Lock "cinder-quobyte-56403c99-7692-4182-bf9f-f176c4865299" released by "delete_volume" :: held 2.012s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Created reservations ['5fcc70b2-c03c-4742-8689-6891ff4cd0a3', '5cddf3ac-3cd0-47a9-a842-b1235d22fa32', '7f4c87b3-fdba-41e7-9155-429cade21e28', '9dc53d03-5464-44f7-893b-075d9c7afd9d'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:34 devstack sudo[99314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:34 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:34 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66" returned: 0 in 0.892s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a8987f-d3a9-4c4c-b4c3-f369f0023d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18584f66-106c-41c3-8be2-2d43e765fd66', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48d909b-23e9-4c00-8082-481d867bdd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:34 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Volume volume-18584f66-106c-41c3-8be2-2d43e765fd66 (18584f66-106c-41c3-8be2-2d43e765fd66): created successfully
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48d909b-23e9-4c00-8082-481d867bdd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Flow 'volume_create_manager' (61c2e455-4c62-4621-ba13-1c760396bfa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:34 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-84ff8711-6d24-4d39-89ab-e48b48f212d9 tempest-VolumesSnapshotTestJSON-832965738 None] Created volume successfully.
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Flow 'volume_create_manager' (65bab924-3b43-4c68-94d0-37dc5d3d0c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47632f0e-c4c1-469b-9ec8-65022c8e2b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47632f0e-c4c1-469b-9ec8-65022c8e2b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1009920342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd8e28b-624a-4c06-989c-00923a3289ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729645c918524a839a831e86f29dd5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:35Z,use_quota=True,user_id='e958f17197d847d4b4c37932127f85a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c4ea39-5d74-4020-aadd-0e09be4f35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c4ea39-5d74-4020-aadd-0e09be4f35b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d749cc-38d0-4e23-b1ec-8b354f8cccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:35 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d749cc-38d0-4e23-b1ec-8b354f8cccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd8e28b-624a-4c06-989c-00923a3289ef', 'volume_name': 'volume-3cd8e28b-624a-4c06-989c-00923a3289ef', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24989c4a-00f5-43c8-a36c-2b397c3fc247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24989c4a-00f5-43c8-a36c-2b397c3fc247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265f7ded-7eb8-4975-9c72-dcbbad959157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:35 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Volume 3cd8e28b-624a-4c06-989c-00923a3289ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd8e28b-624a-4c06-989c-00923a3289ef', 'volume_size': 1}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1009920342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd8e28b-624a-4c06-989c-00923a3289ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729645c918524a839a831e86f29dd5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:35Z,use_quota=True,user_id='e958f17197d847d4b4c37932127f85a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Creating volume 3cd8e28b-624a-4c06-989c-00923a3289ef {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:37:35 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.931s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:35 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Deleted volume successfully.
Jul 06 15:37:35 devstack sudo[99338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef 1073741824
Jul 06 15:37:35 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8b80a0f-2458-4b5a-a908-ffcba060c11e tempest-ProjectReaderTests-2024003838 None] Lock "cinder-56403c99-7692-4182-bf9f-f176c4865299-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:36 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef 1073741824" returned: 0 in 1.207s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:36 devstack sudo[99346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef
Jul 06 15:37:36 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:37 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef" returned: 0 in 0.964s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.385s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Creating offline snapshot 43818b78-3c18-4569-9f4c-202704f34b30 of volume 18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265f7ded-7eb8-4975-9c72-dcbbad959157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd8e28b-624a-4c06-989c-00923a3289ef', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcce4d0-51bc-4f33-bce0-f50d9494166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b75a45d-fdb5-460c-8f10-bd533859f50c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:37 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Volume volume-3cd8e28b-624a-4c06-989c-00923a3289ef (3cd8e28b-624a-4c06-989c-00923a3289ef): created successfully
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcce4d0-51bc-4f33-bce0-f50d9494166f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Flow 'volume_create_manager' (65bab924-3b43-4c68-94d0-37dc5d3d0c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:37 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9f9aad86-8811-4017-859a-2ec10309de17 tempest-ProjectReaderTests-2024003838 None] Created volume successfully.
Jul 06 15:37:37 devstack sudo[99350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66
Jul 06 15:37:37 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Acquiring lock "cinder-3cd8e28b-624a-4c06-989c-00923a3289ef-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Lock "cinder-3cd8e28b-624a-4c06-989c-00923a3289ef-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Acquiring lock "cinder-quobyte-3cd8e28b-624a-4c06-989c-00923a3289ef" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Lock "cinder-quobyte-3cd8e28b-624a-4c06-989c-00923a3289ef" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[26905d89-b6e2-41ac-a6ab-33b051c6093b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:38 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66" returned: 0 in 1.115s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:38 devstack sudo[99356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 1G
Jul 06 15:37:38 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:38 devstack sudo[99355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef
Jul 06 15:37:38 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:40 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 1G" returned: 0 in 1.264s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18584f66-106c-41c3-8be2-2d43e765fd66 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:40 devstack sudo[99368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18584f66-106c-41c3-8be2-2d43e765fd66 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30
Jul 06 15:37:40 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:40 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef" returned: 0 in 1.486s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:40 devstack sudo[99371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef
Jul 06 15:37:40 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:41 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18584f66-106c-41c3-8be2-2d43e765fd66 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30" returned: 0 in 1.296s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:41 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 is being set with open permissions: ugo+rw
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:41 devstack sudo[99389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30
Jul 06 15:37:41 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:41 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3cd8e28b-624a-4c06-989c-00923a3289ef" returned: 0 in 1.529s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Lock "cinder-quobyte-3cd8e28b-624a-4c06-989c-00923a3289ef" released by "delete_volume" :: held 3.088s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Created reservations ['5a2db9a8-45dd-4d9a-aa12-57ea11557d7c', '05c4d2fa-6bab-41a6-92be-8a1a13e32af2', 'cabdf5b3-59ee-4c49-933f-e6e5a191d0d9', '1cbcb6b9-51c9-4aaa-8eb5-b7dab47c1f5c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:41 devstack sudo[99392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:42 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:42 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30" returned: 0 in 0.969s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:42 devstack sudo[99395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.info
Jul 06 15:37:42 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Flow 'volume_create_manager' (447e9729-fafd-4873-951b-91c3aebae5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257d7c82-73e3-4b98-b22b-a24db6d5d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257d7c82-73e3-4b98-b22b-a24db6d5d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1028396705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95bd24c-c93d-4098-a0e4-21d864a55f37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5edac9d550c49e8a5988cb89ef0320d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:43Z,use_quota=True,user_id='69ae97a7002646dc96d365412e1a45bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d3de62-1958-4a27-99c9-729211dea92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d3de62-1958-4a27-99c9-729211dea92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87ab6ca-507b-4f52-afb1-9bc7b94e121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87ab6ca-507b-4f52-afb1-9bc7b94e121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95bd24c-c93d-4098-a0e4-21d864a55f37', 'volume_name': 'volume-f95bd24c-c93d-4098-a0e4-21d864a55f37', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b674c386-ba67-46a9-894f-e7c418632dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b674c386-ba67-46a9-894f-e7c418632dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10f4955-79a3-4ef4-9dc4-7f113ae9d8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:43 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Volume f95bd24c-c93d-4098-a0e4-21d864a55f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95bd24c-c93d-4098-a0e4-21d864a55f37', 'volume_size': 1}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:43 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.676s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Deleted volume successfully.
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b8a67a80-c785-4b99-a1e8-fe986e4a7f2c tempest-ProjectReaderTests-2024003838 None] Lock "cinder-3cd8e28b-624a-4c06-989c-00923a3289ef-delete_volume" released by "delete_volume" :: held 5.106s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:43 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.info" returned: 0 in 1.484s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:43 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.info is being set with open permissions: ugo+rw
Jul 06 15:37:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:43 devstack sudo[99401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.info
Jul 06 15:37:43 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:44 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.info" returned: 0 in 0.898s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.207s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1028396705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95bd24c-c93d-4098-a0e4-21d864a55f37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5edac9d550c49e8a5988cb89ef0320d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:43Z,use_quota=True,user_id='69ae97a7002646dc96d365412e1a45bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Creating volume f95bd24c-c93d-4098-a0e4-21d864a55f37 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:37:44 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:37:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:44 devstack sudo[99404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37 1073741824
Jul 06 15:37:44 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:44 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4cd4b99f-a93b-4991-90e1-a10415de96a4 tempest-VolumesSnapshotTestJSON-832965738 None] Create snapshot completed successfully
Jul 06 15:37:45 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37 1073741824" returned: 0 in 0.930s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:45 devstack sudo[99410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37
Jul 06 15:37:45 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Flow 'volume_create_manager' (372a8615-0731-4970-a6cd-8ff413589469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6b94d5-e1ba-44d3-922b-1585cb0d775b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6b94d5-e1ba-44d3-922b-1585cb0d775b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1720254647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274ce60e-ca4d-4b61-a3d7-a4ef45545c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5940cdc1fe8c4ded82be2498e1aa4582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43818b78-3c18-4569-9f4c-202704f34b30,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:46Z,use_quota=True,user_id='f6d504c73ca14f209ec8b8bc2e482ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfb84bc-0c3b-4b4f-bf7c-db58f79b00a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfb84bc-0c3b-4b4f-bf7c-db58f79b00a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb36f7da-787f-404d-a1bc-98e074ce5bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb36f7da-787f-404d-a1bc-98e074ce5bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '274ce60e-ca4d-4b61-a3d7-a4ef45545c6e', 'volume_name': 'volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e', 'volume_size': 1, 'snapshot_id': '43818b78-3c18-4569-9f4c-202704f34b30'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:46 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c40d5b-43f9-4035-9367-b5ad25446018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c40d5b-43f9-4035-9367-b5ad25446018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b680df81-da2a-4de4-9f6c-a23bfc4660fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:46 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Volume 274ce60e-ca4d-4b61-a3d7-a4ef45545c6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e', 'volume_size': 1, 'snapshot_id': '43818b78-3c18-4569-9f4c-202704f34b30'}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37" returned: 0 in 0.765s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-43818b78-3c18-4569-9f4c-202704f34b30-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" by "_create_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10f4955-79a3-4ef4-9dc4-7f113ae9d8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95bd24c-c93d-4098-a0e4-21d864a55f37', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287ded61-e874-4bb8-8896-a8c57a7334b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-43818b78-3c18-4569-9f4c-202704f34b30-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Creating volume 274ce60e-ca4d-4b61-a3d7-a4ef45545c6e from snapshot 43818b78-3c18-4569-9f4c-202704f34b30 {{(pid=86249) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:46 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Volume volume-f95bd24c-c93d-4098-a0e4-21d864a55f37 (f95bd24c-c93d-4098-a0e4-21d864a55f37): created successfully
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287ded61-e874-4bb8-8896-a8c57a7334b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Flow 'volume_create_manager' (447e9729-fafd-4873-951b-91c3aebae5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] snapshot: 43818b78-3c18-4569-9f4c-202704f34b30, volume: 274ce60e-ca4d-4b61-a3d7-a4ef45545c6e,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:37:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-db76c7c8-9eaa-4ace-8f89-7de73c1fa99b tempest-VolumesTestJSON-1324291480 None] Created volume successfully.
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[95644a55-09ef-4c78-8aa7-e5f366c18ba9]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:46 devstack sudo[99413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30
Jul 06 15:37:46 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:47 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30" returned: 0 in 0.827s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18584f66-106c-41c3-8be2-2d43e765fd66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b0882-836d-4220-89ac-f2db59356dbc]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:47 devstack sudo[99418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66
Jul 06 15:37:47 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Flow 'volume_create_manager' (dddfb5b3-d2ad-43a6-bbc7-3133bbf9e25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dfae11-5e6f-4504-88b0-d8c66e96960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dfae11-5e6f-4504-88b0-d8c66e96960a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1149515013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a446a1-d7de-4907-8d0c-5a983b50a38c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5edac9d550c49e8a5988cb89ef0320d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:48Z,use_quota=True,user_id='69ae97a7002646dc96d365412e1a45bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637519a5-26b3-4b88-a951-79e1547efa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637519a5-26b3-4b88-a951-79e1547efa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053c1347-06e4-4ab8-b5a9-ec103f26bb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053c1347-06e4-4ab8-b5a9-ec103f26bb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a446a1-d7de-4907-8d0c-5a983b50a38c', 'volume_name': 'volume-57a446a1-d7de-4907-8d0c-5a983b50a38c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4b72d2-9dbc-4c8a-8a67-255566ff12b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4b72d2-9dbc-4c8a-8a67-255566ff12b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d944d2-0022-494f-9d52-4233dc135f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:47 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Volume 57a446a1-d7de-4907-8d0c-5a983b50a38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a446a1-d7de-4907-8d0c-5a983b50a38c', 'volume_size': 1}
Jul 06 15:37:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:48 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66" returned: 0 in 0.800s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:48 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:37:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:48 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e
Jul 06 15:37:48 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:52 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" returned: 0 in 4.240s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:52 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a6d214-5b9c-4124-88f0-ccbec74bf6fa]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:52 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66
Jul 06 15:37:52 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:53 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66" returned: 0 in 0.859s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:53 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66, size 1024.00 MB, duration 4.24 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:37:53 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Converted 1024.00 MB image at 241.47 MB/s
Jul 06 15:37:53 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e is being set with open permissions: ugo+rw
Jul 06 15:37:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:53 devstack sudo[99448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e
Jul 06 15:37:53 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:54 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" returned: 0 in 0.604s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" released by "_copy_volume_from_snapshot" :: held 7.426s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-43818b78-3c18-4569-9f4c-202704f34b30-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" released by "_create_volume_from_snapshot" :: held 7.480s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.508s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.138s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1149515013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a446a1-d7de-4907-8d0c-5a983b50a38c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5edac9d550c49e8a5988cb89ef0320d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:48Z,use_quota=True,user_id='69ae97a7002646dc96d365412e1a45bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Creating volume 57a446a1-d7de-4907-8d0c-5a983b50a38c {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:37:54 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:54 devstack sudo[99451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c 1073741824
Jul 06 15:37:54 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b680df81-da2a-4de4-9f6c-a23bfc4660fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e', 'volume_size': 1, 'snapshot_id': '43818b78-3c18-4569-9f4c-202704f34b30'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb180561-f70a-4501-b887-4fb4af3d42ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:54 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Volume volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e (274ce60e-ca4d-4b61-a3d7-a4ef45545c6e): created successfully
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb180561-f70a-4501-b887-4fb4af3d42ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Flow 'volume_create_manager' (372a8615-0731-4970-a6cd-8ff413589469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:54 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-60e9430c-a1e8-4052-ab4c-b2b0d06f2356 tempest-VolumesSnapshotTestJSON-832965738 None] Created volume successfully.
Jul 06 15:37:54 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c 1073741824" returned: 0 in 0.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:54 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c
Jul 06 15:37:54 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac162aa-065f-419a-94f3-fa46ed432766]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:55 devstack sudo[99459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e
Jul 06 15:37:55 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:55 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c" returned: 0 in 0.642s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d944d2-0022-494f-9d52-4233dc135f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a446a1-d7de-4907-8d0c-5a983b50a38c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219dca60-7254-4546-a3f9-d6590f8a7e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:55 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Volume volume-57a446a1-d7de-4907-8d0c-5a983b50a38c (57a446a1-d7de-4907-8d0c-5a983b50a38c): created successfully
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219dca60-7254-4546-a3f9-d6590f8a7e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Flow 'volume_create_manager' (dddfb5b3-d2ad-43a6-bbc7-3133bbf9e25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-77071b95-37b1-4441-80f5-3100fca15dec tempest-VolumesTestJSON-1324291480 None] Created volume successfully.
Jul 06 15:37:56 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" returned: 0 in 0.746s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:56 devstack sudo[99465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e
Jul 06 15:37:56 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:56 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" returned: 0 in 0.626s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e" released by "delete_volume" :: held 1.438s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Created reservations ['a3382956-da07-4dd6-9413-ec3f373072c2', '0705c44f-718b-4ff2-934c-245a5ec2fed8', '64a72403-c2dc-4c1b-83f5-c275b27647cb', '36d79886-a683-46ff-a641-8edfb758d479'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:56 devstack sudo[99468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:37:56 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:56 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Flow 'volume_create_manager' (5ddfead5-26d0-4d10-9da8-01bcec2563bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f3d43e-5c7e-4dea-a218-0843eb62fb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f3d43e-5c7e-4dea-a218-0843eb62fb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1344008244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0db871-a260-454d-81ec-6e9dc173ffcc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5edac9d550c49e8a5988cb89ef0320d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:57Z,use_quota=True,user_id='69ae97a7002646dc96d365412e1a45bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3178f9f0-7e05-4769-be05-f3dcb8b5e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3178f9f0-7e05-4769-be05-f3dcb8b5e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2bf8c8-260e-452f-b5c4-a2616d1b9cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2bf8c8-260e-452f-b5c4-a2616d1b9cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0db871-a260-454d-81ec-6e9dc173ffcc', 'volume_name': 'volume-eb0db871-a260-454d-81ec-6e9dc173ffcc', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e0ce40-9c49-44f0-b174-b3b8c53ab7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e0ce40-9c49-44f0-b174-b3b8c53ab7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72959929-4256-4d4e-932a-7115e28386a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:57 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Volume eb0db871-a260-454d-81ec-6e9dc173ffcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0db871-a260-454d-81ec-6e9dc173ffcc', 'volume_size': 1}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1344008244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0db871-a260-454d-81ec-6e9dc173ffcc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5edac9d550c49e8a5988cb89ef0320d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:57Z,use_quota=True,user_id='69ae97a7002646dc96d365412e1a45bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Creating volume eb0db871-a260-454d-81ec-6e9dc173ffcc {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:37:57 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:57 devstack sudo[99470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc 1073741824
Jul 06 15:37:57 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-43818b78-3c18-4569-9f4c-202704f34b30-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-43818b78-3c18-4569-9f4c-202704f34b30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-18584f66-106c-41c3-8be2-2d43e765fd66" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-18584f66-106c-41c3-8be2-2d43e765fd66" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-43818b78-3c18-4569-9f4c-202704f34b30" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:37:57 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.701s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:37:57 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Deleted volume successfully.
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-43818b78-3c18-4569-9f4c-202704f34b30" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Deleting offline snapshot 43818b78-3c18-4569-9f4c-202704f34b30 of volume 18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] snapshot_file for this snap is: volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6614a0f0-a0f1-4fda-90f9-2cc2b19ba023]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a8bee6f6-c094-43a1-9bdb-57ddf34d446c tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-274ce60e-ca4d-4b61-a3d7-a4ef45545c6e-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:37:57 devstack sudo[99473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30
Jul 06 15:37:57 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:57 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc 1073741824" returned: 0 in 0.842s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:57 devstack sudo[99478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc
Jul 06 15:37:57 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:58 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30" returned: 0 in 0.764s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18584f66-106c-41c3-8be2-2d43e765fd66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8372aba0-3df8-43e9-8cab-28fef2f48e6e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:58 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66
Jul 06 15:37:58 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:58 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc" returned: 0 in 0.626s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72959929-4256-4d4e-932a-7115e28386a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0db871-a260-454d-81ec-6e9dc173ffcc', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4835c9-fda9-4dde-b233-5006b2ed87cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:37:58 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Volume volume-eb0db871-a260-454d-81ec-6e9dc173ffcc (eb0db871-a260-454d-81ec-6e9dc173ffcc): created successfully
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4835c9-fda9-4dde-b233-5006b2ed87cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:37:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Flow 'volume_create_manager' (5ddfead5-26d0-4d10-9da8-01bcec2563bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:37:58 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ef4aef4b-a139-4022-a879-fda191cc5888 tempest-VolumesTestJSON-1324291480 None] Created volume successfully.
Jul 06 15:37:59 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66" returned: 0 in 0.763s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:59 devstack sudo[99490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30
Jul 06 15:37:59 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:37:59 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root
Jul 06 15:37:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30" returned: 0 in 0.748s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:37:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:37:59 devstack sudo[99497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30
Jul 06 15:37:59 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Acquiring lock "cinder-eb0db871-a260-454d-81ec-6e9dc173ffcc-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Lock "cinder-eb0db871-a260-454d-81ec-6e9dc173ffcc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Acquiring lock "cinder-quobyte-eb0db871-a260-454d-81ec-6e9dc173ffcc" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Lock "cinder-quobyte-eb0db871-a260-454d-81ec-6e9dc173ffcc" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e6bfc6-b55c-4109-bf42-c251333bcd3b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:00 devstack sudo[99499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc
Jul 06 15:38:00 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:00 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66.43818b78-3c18-4569-9f4c-202704f34b30" returned: 0 in 0.668s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-43818b78-3c18-4569-9f4c-202704f34b30" released by "_delete_snapshot" :: held 3.059s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-18584f66-106c-41c3-8be2-2d43e765fd66" released by "delete_snapshot" :: held 3.098s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Created reservations ['d307a359-f17e-4445-aa5a-80e4b9c6ab92', 'c7584458-5823-48ca-81bd-3e72e2698377', '9b52a533-2a91-4b11-ac0f-d0b73f53b147', '0900d780-5241-493e-b288-4f9553dc6edf'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:00 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Delete snapshot completed successfully.
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df4ef9d3-d3c8-48a6-a332-ad192ae320ca tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-43818b78-3c18-4569-9f4c-202704f34b30-delete_snapshot" released by "delete_snapshot" :: held 3.253s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:00 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc" returned: 0 in 0.785s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:00 devstack sudo[99505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc
Jul 06 15:38:00 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:01 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb0db871-a260-454d-81ec-6e9dc173ffcc" returned: 0 in 0.646s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Lock "cinder-quobyte-eb0db871-a260-454d-81ec-6e9dc173ffcc" released by "delete_volume" :: held 1.474s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Created reservations ['94f0454c-7e0e-4535-b6b5-d8b3cd67be6c', '3fff6dc4-5f5c-4737-870c-d30960685eb2', '9df537c8-64b8-4f16-a9a1-1cc530de26ad', '1df05f57-c352-4031-9597-a87d0a9a005e'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:01 devstack sudo[99508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:01 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-18584f66-106c-41c3-8be2-2d43e765fd66-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-18584f66-106c-41c3-8be2-2d43e765fd66-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-18584f66-106c-41c3-8be2-2d43e765fd66" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-18584f66-106c-41c3-8be2-2d43e765fd66" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6b82ef-823a-4a6e-9f61-07add1a0dcdf]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:02 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66
Jul 06 15:38:02 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Acquiring lock "cinder-57a446a1-d7de-4907-8d0c-5a983b50a38c-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Lock "cinder-57a446a1-d7de-4907-8d0c-5a983b50a38c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Acquiring lock "cinder-quobyte-57a446a1-d7de-4907-8d0c-5a983b50a38c" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Lock "cinder-quobyte-57a446a1-d7de-4907-8d0c-5a983b50a38c" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f41ab8a-5afa-4ea8-8067-0d0bc3061eac]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:02 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.762s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:02 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Deleted volume successfully.
Jul 06 15:38:02 devstack sudo[99513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c
Jul 06 15:38:02 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-940c9ca7-0282-4e71-ba36-0f4a25b6a755 tempest-VolumesTestJSON-1324291480 None] Lock "cinder-eb0db871-a260-454d-81ec-6e9dc173ffcc-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:02 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66" returned: 0 in 0.779s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:02 devstack sudo[99518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66
Jul 06 15:38:02 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:03 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c" returned: 0 in 0.764s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:03 devstack sudo[99527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c
Jul 06 15:38:03 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:03 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18584f66-106c-41c3-8be2-2d43e765fd66" returned: 0 in 0.626s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-18584f66-106c-41c3-8be2-2d43e765fd66" released by "delete_volume" :: held 1.500s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Created reservations ['1daec2d0-abae-4eca-9cef-d0b5804b1c29', '27aee97d-5ea6-4454-a8f2-8dcd2e09fd46', '3cc12905-fa5a-496b-bfe6-dbc8b827afc3', 'b9e1cff1-81b3-4ec6-b61e-d645740e3817'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:03 devstack sudo[99533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:03 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:03 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-57a446a1-d7de-4907-8d0c-5a983b50a38c" returned: 0 in 0.671s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Lock "cinder-quobyte-57a446a1-d7de-4907-8d0c-5a983b50a38c" released by "delete_volume" :: held 1.485s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Created reservations ['72c96e2d-738b-4558-b6f9-123cad6ac833', 'f15e3f5e-c4ed-4c4c-8f53-30af0409f760', 'd7845c51-6cf9-4414-85e6-cdd8a24066a9', '2bb8feca-9283-481d-9943-d030fdbb280e'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:03 devstack sudo[99536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:03 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-5a2f0cea-2e9e-45ea-a2a6-5469180956c2-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-5a2f0cea-2e9e-45ea-a2a6-5469180956c2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "cinder-quobyte-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:04 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.680s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Deleted volume successfully.
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b6b41-9087-4cc3-8be4-ad27063fdab7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3cf0605d-eaa5-46fd-b63a-eb14f9b53244 tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-18584f66-106c-41c3-8be2-2d43e765fd66-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:04 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2
Jul 06 15:38:04 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Acquiring lock "cinder-f95bd24c-c93d-4098-a0e4-21d864a55f37-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Lock "cinder-f95bd24c-c93d-4098-a0e4-21d864a55f37-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Acquiring lock "cinder-quobyte-f95bd24c-c93d-4098-a0e4-21d864a55f37" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Lock "cinder-quobyte-f95bd24c-c93d-4098-a0e4-21d864a55f37" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d357f426-0459-469b-b0d0-379aec03d681]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:04 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.759s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Deleted volume successfully.
Jul 06 15:38:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f314c141-5000-42f1-8297-fd2455d07a4c tempest-VolumesTestJSON-1324291480 None] Lock "cinder-57a446a1-d7de-4907-8d0c-5a983b50a38c-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:04 devstack sudo[99542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37
Jul 06 15:38:04 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:05 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" returned: 0 in 0.803s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:05 devstack sudo[99547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2
Jul 06 15:38:05 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:05 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37" returned: 0 in 0.745s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:05 devstack sudo[99552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37
Jul 06 15:38:05 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:05 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" returned: 0 in 0.689s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-quobyte-5a2f0cea-2e9e-45ea-a2a6-5469180956c2" released by "delete_volume" :: held 1.567s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Created reservations ['97bb9ea3-83ce-4539-a2a3-5077ebcb040a', 'c8bf953a-5574-410f-a729-f4a7c5a71fd6', 'c9f8dc0b-e78d-4a19-8c3f-989a1562618e', 'daa190d0-5626-4634-9a27-91892ddf3b4b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:05 devstack sudo[99555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:05 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:06 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f95bd24c-c93d-4098-a0e4-21d864a55f37" returned: 0 in 0.666s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Lock "cinder-quobyte-f95bd24c-c93d-4098-a0e4-21d864a55f37" released by "delete_volume" :: held 1.453s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Created reservations ['884e90b2-7904-40ca-b5fc-19042284b3da', '4bdaabe8-e9c6-4b7f-931d-9449c5f475c1', '491c9502-41ee-4b30-9b6b-6daa51348ca3', 'a669117e-d7c9-4df1-aaae-d9e800e8f1b1'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:06 devstack sudo[99558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:06 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:06 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.706s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:06 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Deleted volume successfully.
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-292d781b-ff49-4405-afde-28e002dde81b tempest-VolumesSnapshotTestJSON-832965738 None] Lock "cinder-5a2f0cea-2e9e-45ea-a2a6-5469180956c2-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:06 devstack sudo[99569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:06 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-da3e4e15-0158-46d0-94bc-b2943a9cf03c req-6187d8cb-b79c-44d6-86dc-fc57f41aa5cc tempest-TestStampPattern-1993956774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-da3e4e15-0158-46d0-94bc-b2943a9cf03c req-6187d8cb-b79c-44d6-86dc-fc57f41aa5cc tempest-TestStampPattern-1993956774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[46991e44-1dad-4aba-9b0c-8149ef690d9f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-da3e4e15-0158-46d0-94bc-b2943a9cf03c req-6187d8cb-b79c-44d6-86dc-fc57f41aa5cc tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:06 devstack sudo[99571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0
Jul 06 15:38:06 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:07 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.806s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:07 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Deleted volume successfully.
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7f902bc-d981-43b0-8058-11a5f0640206 tempest-VolumesTestJSON-1324291480 None] Lock "cinder-f95bd24c-c93d-4098-a0e4-21d864a55f37-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:07 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.912s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:38:07 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-da3e4e15-0158-46d0-94bc-b2943a9cf03c req-6187d8cb-b79c-44d6-86dc-fc57f41aa5cc tempest-TestStampPattern-1993956774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0" returned: 0 in 1.051s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-da3e4e15-0158-46d0-94bc-b2943a9cf03c req-6187d8cb-b79c-44d6-86dc-fc57f41aa5cc tempest-TestStampPattern-1993956774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.077s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-da3e4e15-0158-46d0-94bc-b2943a9cf03c req-6187d8cb-b79c-44d6-86dc-fc57f41aa5cc tempest-TestStampPattern-1993956774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-1a1c922b-1619-4992-afa7-884c0ac641e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc9c4407-5184-4423-8768-63046f3bc6db', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:38:07 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-da3e4e15-0158-46d0-94bc-b2943a9cf03c req-6187d8cb-b79c-44d6-86dc-fc57f41aa5cc tempest-TestStampPattern-1993956774 None] attachment_update completed successfully.
Jul 06 15:38:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3e200ade-f202-4973-925b-758ddc67e6d9 tempest-GroupsTest-1593476187 None] Group tempest-Group1-590560815: creating
Jul 06 15:38:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3e200ade-f202-4973-925b-758ddc67e6d9 tempest-GroupsTest-1593476187 None] Group tempest-Group1-590560815: created successfully
Jul 06 15:38:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3e200ade-f202-4973-925b-758ddc67e6d9 tempest-GroupsTest-1593476187 None] Create group completed successfully.
Jul 06 15:38:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-500ce5d6-e3cd-407c-985d-597c39e35aa6 tempest-GroupsTest-1593476187 None] Group tempest-Group2-2139542797: creating
Jul 06 15:38:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-500ce5d6-e3cd-407c-985d-597c39e35aa6 tempest-GroupsTest-1593476187 None] Group tempest-Group2-2139542797: created successfully
Jul 06 15:38:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-500ce5d6-e3cd-407c-985d-597c39e35aa6 tempest-GroupsTest-1593476187 None] Create group completed successfully.
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Flow 'volume_create_manager' (a92130ef-2073-4866-84ad-b3af7518fc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38acd640-5776-4c93-bf19-58215a814992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38acd640-5776-4c93-bf19-58215a814992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1499473146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e7d6bf-b56b-4beb-b23f-bf9e0035a1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ddc8ea17a54c2f8f710646ba1904db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:14Z,use_quota=True,user_id='afbcd380518842809ceefa284a17ae24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16193515-43fa-4f2a-b7dc-15a02786de4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16193515-43fa-4f2a-b7dc-15a02786de4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024390e0-2f8b-41d8-8f2e-250afe48daaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024390e0-2f8b-41d8-8f2e-250afe48daaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e7d6bf-b56b-4beb-b23f-bf9e0035a1be', 'volume_name': 'volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc902ceb-aaf4-4358-9006-e118d3bfb5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc902ceb-aaf4-4358-9006-e118d3bfb5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0e0a95-bf9b-4fc7-bc39-621d2c4e62ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:13 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Volume 01e7d6bf-b56b-4beb-b23f-bf9e0035a1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be', 'volume_size': 1}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1499473146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e7d6bf-b56b-4beb-b23f-bf9e0035a1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ddc8ea17a54c2f8f710646ba1904db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:14Z,use_quota=True,user_id='afbcd380518842809ceefa284a17ae24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Creating volume 01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:38:13 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:38:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:13 devstack sudo[100018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be 1073741824
Jul 06 15:38:13 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Flow 'volume_create_manager' (f6d4c4fe-b08e-4203-9399-f8d405d497ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bd0974-f68d-470b-87f9-78377aa59d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bd0974-f68d-470b-87f9-78377aa59d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1553197472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fb7e39ce-a661-48b0-96c9-a264a60d183a,host='devstack@QuobyteHD#QuobyteHD',id=3761eb70-0f6d-4592-ae43-e8da920383e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0bbd0e9d344239b65d2775c3a8983b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:14Z,use_quota=True,user_id='31c51211c78949ed8a07126e59b96646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fcdc44e-a490-45bc-8b96-81f2e9f46efa),volume_type_id=5fcdc44e-a490-45bc-8b96-81f2e9f46efa)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00baee9-61ec-4ce0-b20a-027e048781f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00baee9-61ec-4ce0-b20a-027e048781f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d904af-ece6-432c-a86b-b006f801e017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d904af-ece6-432c-a86b-b006f801e017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3761eb70-0f6d-4592-ae43-e8da920383e8', 'volume_name': 'volume-3761eb70-0f6d-4592-ae43-e8da920383e8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ad31eb-b136-48bf-ae78-6289a052bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ad31eb-b136-48bf-ae78-6289a052bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de64302-d22e-40bb-8de0-9ec3b4895e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:14 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Volume 3761eb70-0f6d-4592-ae43-e8da920383e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3761eb70-0f6d-4592-ae43-e8da920383e8', 'volume_size': 1}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:14 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be 1073741824" returned: 0 in 0.945s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:14 devstack sudo[100024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be
Jul 06 15:38:14 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-488e6a4a-2eda-48ae-8af0-c671a477c133 req-241fbbf2-4883-4ee5-80a1-453c5ec8e0bd tempest-TestStampPattern-1993956774 None] Terminate volume connection completed successfully.
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-488e6a4a-2eda-48ae-8af0-c671a477c133 req-241fbbf2-4883-4ee5-80a1-453c5ec8e0bd tempest-TestStampPattern-1993956774 None] Deleting attachment fc9c4407-5184-4423-8768-63046f3bc6db. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:38:15 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" returned: 0 in 0.639s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fb7e39ce-a661-48b0-96c9-a264a60d183a,created_at=2026-07-06T13:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1553197472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fb7e39ce-a661-48b0-96c9-a264a60d183a,host='devstack@QuobyteHD#QuobyteHD',id=3761eb70-0f6d-4592-ae43-e8da920383e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0bbd0e9d344239b65d2775c3a8983b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:14Z,use_quota=True,user_id='31c51211c78949ed8a07126e59b96646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fcdc44e-a490-45bc-8b96-81f2e9f46efa),volume_type_id=5fcdc44e-a490-45bc-8b96-81f2e9f46efa)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Creating volume 3761eb70-0f6d-4592-ae43-e8da920383e8 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:38:15 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0e0a95-bf9b-4fc7-bc39-621d2c4e62ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022ebf9a-f4ea-44b2-a9b3-28ade24df98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:15 devstack sudo[100054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8 1073741824
Jul 06 15:38:15 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:15 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Volume volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be (01e7d6bf-b56b-4beb-b23f-bf9e0035a1be): created successfully
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022ebf9a-f4ea-44b2-a9b3-28ade24df98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Flow 'volume_create_manager' (a92130ef-2073-4866-84ad-b3af7518fc57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fadad71d-a241-4825-9bbe-3fcaf3fd8e3c tempest-VolumesSnapshotListTestJSON-1145999031 None] Created volume successfully.
Jul 06 15:38:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:16 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8 1073741824" returned: 0 in 0.842s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:16 devstack sudo[100060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8
Jul 06 15:38:16 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:16 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8" returned: 0 in 0.631s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.917s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Creating offline snapshot b396002c-e467-411e-a1e8-68f599d40c34 of volume 01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de64302-d22e-40bb-8de0-9ec3b4895e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3761eb70-0f6d-4592-ae43-e8da920383e8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa22718-2d32-4757-9129-4ca904c4c29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ec5363-9375-4290-abc0-191e85c082c8]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:16 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Volume volume-3761eb70-0f6d-4592-ae43-e8da920383e8 (3761eb70-0f6d-4592-ae43-e8da920383e8): created successfully
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa22718-2d32-4757-9129-4ca904c4c29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Flow 'volume_create_manager' (f6d4c4fe-b08e-4203-9399-f8d405d497ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:16 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-91b134ff-0bc9-4ddb-ab0f-cc613479a1a0 tempest-GroupsTest-1593476187 None] Created volume successfully.
Jul 06 15:38:16 devstack sudo[100063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be
Jul 06 15:38:16 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:17 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" returned: 0 in 0.793s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:17 devstack sudo[100068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 1G
Jul 06 15:38:17 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:18 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 1G" returned: 0 in 0.919s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:18 devstack sudo[100076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34
Jul 06 15:38:18 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Acquiring lock "cinder-quobyte-3761eb70-0f6d-4592-ae43-e8da920383e8" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Lock "cinder-quobyte-3761eb70-0f6d-4592-ae43-e8da920383e8" acquired by "delete_volume" :: waited 0.032s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:18 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb6abae-bcb7-4a7c-9674-473b1f459dbb]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:18 devstack sudo[100078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8
Jul 06 15:38:18 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:19 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34" returned: 0 in 0.716s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:19 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 is being set with open permissions: ugo+rw
Jul 06 15:38:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:19 devstack sudo[100084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34
Jul 06 15:38:19 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:19 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8" returned: 0 in 0.866s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:19 devstack sudo[100093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8
Jul 06 15:38:19 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:20 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34" returned: 0 in 0.858s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:20 devstack sudo[100113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.info
Jul 06 15:38:20 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:20 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-3761eb70-0f6d-4592-ae43-e8da920383e8" returned: 0 in 0.806s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Lock "cinder-quobyte-3761eb70-0f6d-4592-ae43-e8da920383e8" released by "delete_volume" :: held 1.719s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Created reservations ['d303db38-37e0-45fe-813f-5e285c05a1a6'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:20 devstack cinder-volume[86249]: WARNING cinder.quota [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1600721880 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1600721880, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:38:20 devstack cinder-volume[86249]: WARNING cinder.quota [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1600721880 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1600721880, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Created reservations ['2b19bfc5-b7b8-4c67-b078-adb92ef72314', 'e53d8949-7500-4681-82ea-60dd88ae930c', 'b2e19ea7-cd2f-40d5-a912-26547b2fac7c', '882bcb35-12d9-4774-912f-596027e89c07'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:20 devstack sudo[100121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:20 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:21 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.info" returned: 0 in 0.841s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:21 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.info is being set with open permissions: ugo+rw
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:21 devstack sudo[100124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.info
Jul 06 15:38:21 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-24de7696-3b69-40b5-9fb9-0a6c3f3feb67 tempest-GroupsTest-1593476187 None] Created reservations ['5450dc8c-6802-45be-9190-b515e754916d'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24de7696-3b69-40b5-9fb9-0a6c3f3feb67 tempest-GroupsTest-1593476187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24de7696-3b69-40b5-9fb9-0a6c3f3feb67 tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24de7696-3b69-40b5-9fb9-0a6c3f3feb67 tempest-GroupsTest-1593476187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24de7696-3b69-40b5-9fb9-0a6c3f3feb67 tempest-GroupsTest-1593476187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24de7696-3b69-40b5-9fb9-0a6c3f3feb67 tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24de7696-3b69-40b5-9fb9-0a6c3f3feb67 tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:21 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.756s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:21 devstack sudo[100128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:21 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b4b94c46-d339-4295-bb65-16c0a20e3b95 tempest-GroupsTest-1593476187 None] Delete group completed successfully.
Jul 06 15:38:21 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:21 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.info" returned: 0 in 0.734s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.978s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:21 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3a8c6fd0-f9c5-4b39-9c9e-01ef1a51ddd6 tempest-VolumesSnapshotListTestJSON-1145999031 None] Create snapshot completed successfully
Jul 06 15:38:22 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24de7696-3b69-40b5-9fb9-0a6c3f3feb67 tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.629s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:22 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-24de7696-3b69-40b5-9fb9-0a6c3f3feb67 tempest-GroupsTest-1593476187 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-24de7696-3b69-40b5-9fb9-0a6c3f3feb67 tempest-GroupsTest-1593476187 None] Delete group completed successfully.
Jul 06 15:38:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] Creating offline snapshot c1172d58-3e8c-4e7c-800a-3e619cd65863 of volume 01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:38:22 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd6d85d-048d-4504-8569-b839bf5726f8]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:22 devstack sudo[100132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34
Jul 06 15:38:22 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5c8dd04d-f67c-4d5a-abd1-f662d264a853 tempest-GroupsTest-1593476187 None] Group tempest-GroupsTest-Group-1575683058: creating
Jul 06 15:38:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5c8dd04d-f67c-4d5a-abd1-f662d264a853 tempest-GroupsTest-1593476187 None] Group tempest-GroupsTest-Group-1575683058: created successfully
Jul 06 15:38:23 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5c8dd04d-f67c-4d5a-abd1-f662d264a853 tempest-GroupsTest-1593476187 None] Create group completed successfully.
Jul 06 15:38:23 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34" returned: 0 in 0.772s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:38:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:23 devstack sudo[100137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 1G
Jul 06 15:38:23 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:24 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 1G" returned: 0 in 0.829s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:24 devstack sudo[100149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863
Jul 06 15:38:24 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Flow 'volume_create_manager' (56756119-e4ca-49fb-b539-72fbd7f6e285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a192c6ff-2dce-41b6-a9d5-6f04380711ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a192c6ff-2dce-41b6-a9d5-6f04380711ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2058305466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce28babc-c3ca-4575-9bc6-419fafd4dd4e,host='devstack@QuobyteHD#QuobyteHD',id=1a3e55dd-3de9-4f32-8d15-4eccd269f815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0bbd0e9d344239b65d2775c3a8983b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:25Z,use_quota=True,user_id='31c51211c78949ed8a07126e59b96646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46fc2120-4328-4604-b225-79483ca65788),volume_type_id=46fc2120-4328-4604-b225-79483ca65788)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfab66a6-fdff-4d6b-9f2b-c24a7be5531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfab66a6-fdff-4d6b-9f2b-c24a7be5531d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee926f8-abbd-44fa-8f7a-1b8a4eb39a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee926f8-abbd-44fa-8f7a-1b8a4eb39a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3e55dd-3de9-4f32-8d15-4eccd269f815', 'volume_name': 'volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57be6c46-fdae-4f04-acda-f7efc75010cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57be6c46-fdae-4f04-acda-f7efc75010cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bd1246-173d-4f79-a085-09f4014e34a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:24 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Volume 1a3e55dd-3de9-4f32-8d15-4eccd269f815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815', 'volume_size': 1}
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:24 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863" returned: 0 in 0.809s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:24 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 is being set with open permissions: ugo+rw
Jul 06 15:38:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:24 devstack sudo[100154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863
Jul 06 15:38:24 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:25 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863" returned: 0 in 0.613s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.141s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ce28babc-c3ca-4575-9bc6-419fafd4dd4e,created_at=2026-07-06T13:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2058305466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce28babc-c3ca-4575-9bc6-419fafd4dd4e,host='devstack@QuobyteHD#QuobyteHD',id=1a3e55dd-3de9-4f32-8d15-4eccd269f815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0bbd0e9d344239b65d2775c3a8983b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:25Z,use_quota=True,user_id='31c51211c78949ed8a07126e59b96646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46fc2120-4328-4604-b225-79483ca65788),volume_type_id=46fc2120-4328-4604-b225-79483ca65788)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Creating volume 1a3e55dd-3de9-4f32-8d15-4eccd269f815 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:38:25 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:25 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815 1073741824
Jul 06 15:38:25 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:25 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8c044d45-3500-4814-90d8-2e25150b71b4 tempest-VolumesSnapshotListTestJSON-1145999031 None] Create snapshot completed successfully
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Acquiring lock "cinder-1a1c922b-1619-4992-afa7-884c0ac641e0-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Lock "cinder-1a1c922b-1619-4992-afa7-884c0ac641e0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Acquiring lock "cinder-quobyte-1a1c922b-1619-4992-afa7-884c0ac641e0" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-1a1c922b-1619-4992-afa7-884c0ac641e0" acquired by "delete_volume" :: waited 0.011s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cd0110-3ee2-45d0-9954-098269da5828]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:25 devstack sudo[100159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0
Jul 06 15:38:25 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:26 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815 1073741824" returned: 0 in 0.827s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:26 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815
Jul 06 15:38:26 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:26 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0" returned: 0 in 0.826s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:26 devstack sudo[100170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0
Jul 06 15:38:26 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:27 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815" returned: 0 in 0.681s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.250s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=117,cinder:UPDATE=147,cinder:INSERT=37,cinder:DELETE=13 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=152,cinder:SELECT=121,cinder:INSERT=28,cinder:DELETE=11 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bd1246-173d-4f79-a085-09f4014e34a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac861e97-e49a-446a-9ec2-f8a8c56dfa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] Creating offline snapshot 40ec6a0b-9647-401f-8a90-64b35408676a of volume 01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:38:27 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Volume volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815 (1a3e55dd-3de9-4f32-8d15-4eccd269f815): created successfully
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac861e97-e49a-446a-9ec2-f8a8c56dfa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Flow 'volume_create_manager' (56756119-e4ca-49fb-b539-72fbd7f6e285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[976cfea2-3bc2-4b04-9155-d6e4aa94be49]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:27 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-29b6bab2-f85e-41f7-b59d-c4457669f254 tempest-GroupsTest-1593476187 None] Created volume successfully.
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a1c922b-1619-4992-afa7-884c0ac641e0" returned: 0 in 0.694s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-1a1c922b-1619-4992-afa7-884c0ac641e0" released by "delete_volume" :: held 1.564s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Created reservations ['21564b13-02da-4041-bca2-8bd0a5ac9615', 'e5996614-3558-4a96-88e6-1bbd81b5515f', '9590044c-538e-4a02-85e1-f2f3522480b0', '28f4d6d3-5fdd-44f0-8d73-bae090206bc8'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:27 devstack sudo[100174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863
Jul 06 15:38:27 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:27 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:27 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:27 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.673s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:27 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:28 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Deleted volume successfully.
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6428d722-d42c-44b2-b390-2e4ac1c85e9b tempest-TestStampPattern-1993956774 None] Lock "cinder-1a1c922b-1619-4992-afa7-884c0ac641e0-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:28 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863" returned: 0 in 0.884s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:28 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a 1G
Jul 06 15:38:28 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Acquiring lock "cinder-93a995a3-f933-4c03-9654-e19a000e89ea-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Lock "cinder-93a995a3-f933-4c03-9654-e19a000e89ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Acquiring lock "cinder-quobyte-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Acquiring lock "cinder-quobyte-93a995a3-f933-4c03-9654-e19a000e89ea" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-93a995a3-f933-4c03-9654-e19a000e89ea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Deleting offline snapshot 93a995a3-f933-4c03-9654-e19a000e89ea of volume 2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] snapshot_file for this snap is: volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb019cb7-ece8-4fad-bd58-f9442251d910]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:28 devstack sudo[100185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea
Jul 06 15:38:28 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Flow 'volume_create_manager' (65f57ff4-435c-477f-99d6-f90fb251ac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b150145f-e0b9-42b9-855b-bd7b504f2ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b150145f-e0b9-42b9-855b-bd7b504f2ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1706199034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce28babc-c3ca-4575-9bc6-419fafd4dd4e,host='devstack@QuobyteHD#QuobyteHD',id=132fe53f-b29d-4d38-b746-b004f35a98af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0bbd0e9d344239b65d2775c3a8983b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:29Z,use_quota=True,user_id='31c51211c78949ed8a07126e59b96646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46fc2120-4328-4604-b225-79483ca65788),volume_type_id=46fc2120-4328-4604-b225-79483ca65788)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ec1206-8af6-4f10-b668-4ede7c12d79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ec1206-8af6-4f10-b668-4ede7c12d79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf58a53b-f426-4b72-a2c5-a9af47b815b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf58a53b-f426-4b72-a2c5-a9af47b815b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132fe53f-b29d-4d38-b746-b004f35a98af', 'volume_name': 'volume-132fe53f-b29d-4d38-b746-b004f35a98af', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c8e180-d911-4ce7-bc97-d9cd1d22aae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c8e180-d911-4ce7-bc97-d9cd1d22aae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e1f2fe-04d6-4d4b-8630-0e7c5e74313e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:28 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Volume 132fe53f-b29d-4d38-b746-b004f35a98af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132fe53f-b29d-4d38-b746-b004f35a98af', 'volume_size': 1}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:28 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a 1G" returned: 0 in 0.941s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:29 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a
Jul 06 15:38:29 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:29 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea" returned: 0 in 0.826s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:38:29 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2f912a-23d7-4adf-950b-e767267b03ff]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:29 devstack sudo[100197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf
Jul 06 15:38:29 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:29 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a" returned: 0 in 0.649s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:29 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a is being set with open permissions: ugo+rw
Jul 06 15:38:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:29 devstack sudo[100202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a
Jul 06 15:38:29 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:29 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" returned: 0 in 0.757s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:29 devstack sudo[100208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea
Jul 06 15:38:29 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:30 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a" returned: 0 in 0.629s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.260s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ce28babc-c3ca-4575-9bc6-419fafd4dd4e,created_at=2026-07-06T13:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1706199034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce28babc-c3ca-4575-9bc6-419fafd4dd4e,host='devstack@QuobyteHD#QuobyteHD',id=132fe53f-b29d-4d38-b746-b004f35a98af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0bbd0e9d344239b65d2775c3a8983b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:29Z,use_quota=True,user_id='31c51211c78949ed8a07126e59b96646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46fc2120-4328-4604-b225-79483ca65788),volume_type_id=46fc2120-4328-4604-b225-79483ca65788)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Creating volume 132fe53f-b29d-4d38-b746-b004f35a98af {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:38:30 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:30 devstack sudo[100211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af 1073741824
Jul 06 15:38:30 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:30 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-82a0ac1e-1d17-4f8a-94c8-72aa6fd0624a tempest-VolumesSnapshotListTestJSON-1145999031 None] Create snapshot completed successfully
Jul 06 15:38:30 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea" returned: 0 in 0.736s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:30 devstack sudo[100216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea
Jul 06 15:38:30 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:31 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af 1073741824" returned: 0 in 0.966s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:31 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf.93a995a3-f933-4c03-9654-e19a000e89ea" returned: 0 in 0.722s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:31 devstack sudo[100223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af
Jul 06 15:38:31 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-93a995a3-f933-4c03-9654-e19a000e89ea" released by "_delete_snapshot" :: held 3.159s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" released by "delete_snapshot" :: held 3.186s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Created reservations ['15e0be29-4b44-47a1-a430-9a9d5273340d', 'ea642fbb-8b68-48a2-bd21-2611c8080ab3', 'c28a185b-ce30-47b1-b088-e7c0b1384ac2', 'c29a5d46-32a4-4817-acc7-2a0acef145d9'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Delete snapshot completed successfully.
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-798cb278-9a76-4868-97a4-943c00c1e15c tempest-TestStampPattern-1993956774 None] Lock "cinder-93a995a3-f933-4c03-9654-e19a000e89ea-delete_snapshot" released by "delete_snapshot" :: held 3.353s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-40ec6a0b-9647-401f-8a90-64b35408676a-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-40ec6a0b-9647-401f-8a90-64b35408676a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-quobyte-40ec6a0b-9647-401f-8a90-64b35408676a" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-40ec6a0b-9647-401f-8a90-64b35408676a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Deleting offline snapshot 40ec6a0b-9647-401f-8a90-64b35408676a of volume 01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] snapshot_file for this snap is: volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d60370-c2f8-43a9-91cf-6b51fa7a670d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:32 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af" returned: 0 in 0.671s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e1f2fe-04d6-4d4b-8630-0e7c5e74313e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132fe53f-b29d-4d38-b746-b004f35a98af', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed80bc00-b24c-4195-afc7-a2b458744771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:32 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Volume volume-132fe53f-b29d-4d38-b746-b004f35a98af (132fe53f-b29d-4d38-b746-b004f35a98af): created successfully
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed80bc00-b24c-4195-afc7-a2b458744771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Flow 'volume_create_manager' (65f57ff4-435c-477f-99d6-f90fb251ac88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:32 devstack sudo[100226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a
Jul 06 15:38:32 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-94214505-824d-451e-9926-77828a6212b0 tempest-GroupsTest-1593476187 None] Created volume successfully.
Jul 06 15:38:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0c9b5ae1-5dd3-45ac-944d-3f80367ec9d3 tempest-GroupsTest-1593476187 None] Update group completed successfully.
Jul 06 15:38:32 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a" returned: 0 in 0.806s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a40f11-dc94-4be4-87a4-d128da52bde0]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:32 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863
Jul 06 15:38:32 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:33 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863" returned: 0 in 0.839s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:38:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:33 devstack sudo[100238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a
Jul 06 15:38:33 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-93f74b3b-ff38-4fc5-a9b0-99825e753292 tempest-GroupsTest-1593476187 None] Update group completed successfully.
Jul 06 15:38:34 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a" returned: 0 in 0.835s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:34 devstack sudo[100246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a
Jul 06 15:38:34 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:35 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.40ec6a0b-9647-401f-8a90-64b35408676a" returned: 0 in 0.657s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-40ec6a0b-9647-401f-8a90-64b35408676a" released by "_delete_snapshot" :: held 3.275s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" released by "delete_snapshot" :: held 3.301s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:35 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Created reservations ['94b75da8-2a22-44fd-aca5-adf242e4d402', '99808c99-5078-4c85-b2d5-926ec80e6d79', '0f0f67e1-287c-4557-b13f-cd9f287e3b58', '0dbd250c-291c-403c-bc55-0dbd16d0a2fc'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:35 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Delete snapshot completed successfully.
Jul 06 15:38:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d318e36d-4aff-464e-a65b-5080ae8f5a67 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-40ec6a0b-9647-401f-8a90-64b35408676a-delete_snapshot" released by "delete_snapshot" :: held 3.508s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Acquiring lock "cinder-quobyte-132fe53f-b29d-4d38-b746-b004f35a98af" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Lock "cinder-quobyte-132fe53f-b29d-4d38-b746-b004f35a98af" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:35 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8541bac4-3a60-41bc-a5ef-f135b5aa5dbf]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:35 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af
Jul 06 15:38:35 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-c1172d58-3e8c-4e7c-800a-3e619cd65863-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-c1172d58-3e8c-4e7c-800a-3e619cd65863-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-quobyte-c1172d58-3e8c-4e7c-800a-3e619cd65863" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-c1172d58-3e8c-4e7c-800a-3e619cd65863" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Deleting offline snapshot c1172d58-3e8c-4e7c-800a-3e619cd65863 of volume 01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] snapshot_file for this snap is: volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb40e3fd-3417-496d-90fb-1b983db3b661]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:36 devstack sudo[100273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863
Jul 06 15:38:36 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:36 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af" returned: 0 in 0.960s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:36 devstack sudo[100279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af
Jul 06 15:38:36 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:37 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863" returned: 0 in 0.891s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:38:37 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1757374f-fb80-45fd-b496-30ef28e05efb]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:37 devstack sudo[100285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34
Jul 06 15:38:37 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:37 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-132fe53f-b29d-4d38-b746-b004f35a98af" returned: 0 in 0.759s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Lock "cinder-quobyte-132fe53f-b29d-4d38-b746-b004f35a98af" released by "delete_volume" :: held 1.780s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Acquiring lock "cinder-quobyte-1a3e55dd-3de9-4f32-8d15-4eccd269f815" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Lock "cinder-quobyte-1a3e55dd-3de9-4f32-8d15-4eccd269f815" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:37 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1c15c1-d823-4af1-9cb2-a91fa3173175]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:37 devstack sudo[100288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815
Jul 06 15:38:37 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:38 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34" returned: 0 in 0.847s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:38:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:38 devstack sudo[100293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863
Jul 06 15:38:38 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:38 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815" returned: 0 in 0.921s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:38 devstack sudo[100298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815
Jul 06 15:38:38 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:38 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863" returned: 0 in 0.946s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:38 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863
Jul 06 15:38:39 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:39 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1a3e55dd-3de9-4f32-8d15-4eccd269f815" returned: 0 in 0.753s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Lock "cinder-quobyte-1a3e55dd-3de9-4f32-8d15-4eccd269f815" released by "delete_volume" :: held 1.729s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Created reservations ['1a5ac14a-ccf3-4f74-8b40-f74cec6e6a5e'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:39 devstack cinder-volume[86249]: WARNING cinder.quota [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1293054279 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1293054279, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:38:39 devstack cinder-volume[86249]: WARNING cinder.quota [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1293054279 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1293054279, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Created reservations ['5823fa14-4b71-4d0b-a790-a396ed314c22', 'f27a465c-c196-4dee-b481-c24e8ed8aa9e', '3d6257df-ca82-4b83-b098-71824bf5cdf0', 'b013f648-1647-4e13-bb8d-a6a0b2e091d6'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Created reservations ['e67f767c-2d9c-434f-b82f-462d49da7c0d', 'c3642777-c2f9-4aaf-a7e2-295342190616', '9fcc5b69-f499-4f86-8474-d842b8704a2a', '6860dd80-cc64-4aee-b9ab-b2032edd720b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:39 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:39 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:39 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.c1172d58-3e8c-4e7c-800a-3e619cd65863" returned: 0 in 0.834s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-c1172d58-3e8c-4e7c-800a-3e619cd65863" released by "_delete_snapshot" :: held 3.651s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" released by "delete_snapshot" :: held 3.674s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Created reservations ['f1ea9d14-8412-47f9-94de-f62b98e0e8f2', 'c6002f18-8f1c-4a61-8966-f10bf34501fa', 'b267fbfd-2961-4ae5-8568-c62a27ab61ad', 'a4aae205-1618-47b1-a893-be865f3aba05'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:39 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Delete snapshot completed successfully.
Jul 06 15:38:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-64ab509e-b3b1-4988-9051-68bbb2e09902 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-c1172d58-3e8c-4e7c-800a-3e619cd65863-delete_snapshot" released by "delete_snapshot" :: held 3.831s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:40 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.691s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:40 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0705a346-16c1-4b4c-b125-9f99b20e1f3c tempest-GroupsTest-1593476187 None] Delete group completed successfully.
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-b396002c-e467-411e-a1e8-68f599d40c34-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-b396002c-e467-411e-a1e8-68f599d40c34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-quobyte-b396002c-e467-411e-a1e8-68f599d40c34" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-b396002c-e467-411e-a1e8-68f599d40c34" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Deleting offline snapshot b396002c-e467-411e-a1e8-68f599d40c34 of volume 01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] snapshot_file for this snap is: volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[772120b6-b921-4fb7-965a-30e79244eb91]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Acquiring lock "cinder-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:40 devstack sudo[100313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34
Jul 06 15:38:40 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Lock "cinder-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Acquiring lock "cinder-quobyte-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[648587e1-17fc-4d78-b75a-510ebfda156d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:40 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf
Jul 06 15:38:40 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:41 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34" returned: 0 in 0.836s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:38:41 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5549cb-9e2e-4315-a557-54f80bcc5c54]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:41 devstack sudo[100320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be
Jul 06 15:38:41 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:41 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" returned: 0 in 0.817s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:41 devstack sudo[100325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf
Jul 06 15:38:41 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:42 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" returned: 0 in 0.831s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:42 devstack sudo[100331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34
Jul 06 15:38:42 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:42 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" returned: 0 in 0.744s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Lock "cinder-quobyte-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf" released by "delete_volume" :: held 1.631s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Created reservations ['d0a1e394-73a7-4fb0-9c66-10bf026d4763', 'df2e2f16-c8c8-43df-a2d7-6b2b944b2721', '6c71765d-49d8-43d7-a532-613768df0d1d', 'bcfe926f-c4de-4473-8e9e-691dfa3a66ad'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:42 devstack sudo[100333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:42 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:43 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34" returned: 0 in 0.886s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:43 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34
Jul 06 15:38:43 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.780s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:43 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:43 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Deleted volume successfully.
Jul 06 15:38:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5710844a-10c9-4ce7-bb8a-b8509021bf58 tempest-TestStampPattern-1993956774 None] Lock "cinder-2f5f6daf-842a-4306-a2ec-5ddeccabdbaf-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:43 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be.b396002c-e467-411e-a1e8-68f599d40c34" returned: 0 in 0.852s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-b396002c-e467-411e-a1e8-68f599d40c34" released by "_delete_snapshot" :: held 3.526s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" released by "delete_snapshot" :: held 3.550s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:44 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Created reservations ['c0ac3151-83bd-4a34-834e-9263a3ef2738', '5d52e866-36e4-4f6d-86b8-4c8be1d2c053', '82bab342-6e65-41f8-ac4e-b83523967265', '6a1f8159-a704-49cd-8bd1-89ce8e026eea'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:44 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Delete snapshot completed successfully.
Jul 06 15:38:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2b1f278a-f16a-45b6-8731-12cfb26d1022 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-b396002c-e467-411e-a1e8-68f599d40c34-delete_snapshot" released by "delete_snapshot" :: held 3.720s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:44 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bb23eb-3d08-470a-ba62-21e486be3066]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:45 devstack sudo[100342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be
Jul 06 15:38:45 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:45 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" returned: 0 in 0.869s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:45 devstack sudo[100348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be
Jul 06 15:38:45 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-662cdc58-14f6-4614-b9d4-e72dce5af7ff tempest-GroupsV314Test-549277274 None] Group tempest-GroupsV314Test-Group-401947690: creating
Jul 06 15:38:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-662cdc58-14f6-4614-b9d4-e72dce5af7ff tempest-GroupsV314Test-549277274 None] Group tempest-GroupsV314Test-Group-401947690: created successfully
Jul 06 15:38:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-662cdc58-14f6-4614-b9d4-e72dce5af7ff tempest-GroupsV314Test-549277274 None] Create group completed successfully.
Jul 06 15:38:46 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" returned: 0 in 0.738s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-quobyte-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be" released by "delete_volume" :: held 1.676s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:46 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Created reservations ['9aec0617-81e4-47fc-bb9e-eb8a31ee78dd', 'ca4f483e-9157-415c-a54e-6fc1e1c07d73', 'b443cad0-0985-46c7-9281-5663525a4608', 'faff1e7c-ea5f-4063-90fa-d6da9ca0e4af'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:38:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:46 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:38:46 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:47 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.775s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:47 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:38:47 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Deleted volume successfully.
Jul 06 15:38:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d5ea0f14-3949-4586-8720-ce400d080013 tempest-VolumesSnapshotListTestJSON-1145999031 None] Lock "cinder-01e7d6bf-b56b-4beb-b23f-bf9e0035a1be-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Flow 'volume_create_manager' (41e58a1f-ea9a-4a4e-8af4-c6698dd4abda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3282ee-e900-4b87-8f25-94d8cf0f2dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3282ee-e900-4b87-8f25-94d8cf0f2dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622496423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a5549071-1b91-47f1-a9ef-a9f9a74f8ba6,host='devstack@QuobyteHD#QuobyteHD',id=337c9b72-707b-43b1-ba0c-22563496f959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dced13637e504194b7daed955dd2c7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:48Z,use_quota=True,user_id='2b812b188fc146afbbef46318a01104d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(780601f1-1840-4027-8552-74e832c9b0b1),volume_type_id=780601f1-1840-4027-8552-74e832c9b0b1)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6120dc4f-09c6-4167-a7d2-60c03dd9518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6120dc4f-09c6-4167-a7d2-60c03dd9518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4686cbd-5768-4d92-8406-aed2f8fdd2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4686cbd-5768-4d92-8406-aed2f8fdd2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337c9b72-707b-43b1-ba0c-22563496f959', 'volume_name': 'volume-337c9b72-707b-43b1-ba0c-22563496f959', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ad29f1-3edd-478a-87b3-79b70cb23115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ad29f1-3edd-478a-87b3-79b70cb23115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f007bd1-c150-48c0-9004-0110eb3fcea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:48 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Volume 337c9b72-707b-43b1-ba0c-22563496f959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337c9b72-707b-43b1-ba0c-22563496f959', 'volume_size': 1}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a5549071-1b91-47f1-a9ef-a9f9a74f8ba6,created_at=2026-07-06T13:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622496423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a5549071-1b91-47f1-a9ef-a9f9a74f8ba6,host='devstack@QuobyteHD#QuobyteHD',id=337c9b72-707b-43b1-ba0c-22563496f959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dced13637e504194b7daed955dd2c7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:48Z,use_quota=True,user_id='2b812b188fc146afbbef46318a01104d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(780601f1-1840-4027-8552-74e832c9b0b1),volume_type_id=780601f1-1840-4027-8552-74e832c9b0b1)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Creating volume 337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:38:48 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:38:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:48 devstack sudo[100355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 1073741824
Jul 06 15:38:48 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:49 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 1073741824" returned: 0 in 0.951s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:49 devstack sudo[100361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959
Jul 06 15:38:49 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:50 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959" returned: 0 in 0.760s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f007bd1-c150-48c0-9004-0110eb3fcea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337c9b72-707b-43b1-ba0c-22563496f959', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cabba76-8241-498c-b4ce-aca3bba7e006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:50 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Volume volume-337c9b72-707b-43b1-ba0c-22563496f959 (337c9b72-707b-43b1-ba0c-22563496f959): created successfully
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cabba76-8241-498c-b4ce-aca3bba7e006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Flow 'volume_create_manager' (41e58a1f-ea9a-4a4e-8af4-c6698dd4abda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:50 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0b976319-9817-405f-8bea-0e3a6ac3c022 tempest-GroupsV314Test-549277274 None] Created volume successfully.
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Flow 'volume_create_manager' (c9c4524e-1c0a-46f8-b3a1-d6ad20261c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a21d68-88d4-4f3d-898e-767216791c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a21d68-88d4-4f3d-898e-767216791c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-615897293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003723e9-b77d-4fa1-b77e-2eeccea27139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b222daf6e5247708037666787d05711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:51Z,use_quota=True,user_id='c4f147ace49549d6917d43cab33f0ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0917a5c1-b73b-416c-b06b-d2904a2b3398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0917a5c1-b73b-416c-b06b-d2904a2b3398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea01bdc-3c75-4a47-a0a8-0b0107e57760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea01bdc-3c75-4a47-a0a8-0b0107e57760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003723e9-b77d-4fa1-b77e-2eeccea27139', 'volume_name': 'volume-003723e9-b77d-4fa1-b77e-2eeccea27139', 'volume_size': 2}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56429f3b-f04b-4bcb-95be-ad21c4a31993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56429f3b-f04b-4bcb-95be-ad21c4a31993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebcff9a-5351-4531-9609-d3a896483e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:50 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Volume 003723e9-b77d-4fa1-b77e-2eeccea27139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003723e9-b77d-4fa1-b77e-2eeccea27139', 'volume_size': 2}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-615897293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003723e9-b77d-4fa1-b77e-2eeccea27139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b222daf6e5247708037666787d05711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:51Z,use_quota=True,user_id='c4f147ace49549d6917d43cab33f0ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Creating volume 003723e9-b77d-4fa1-b77e-2eeccea27139 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:38:50 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:38:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139 2147483648 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:50 devstack sudo[100366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139 2147483648
Jul 06 15:38:50 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:51 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139 2147483648" returned: 0 in 1.105s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:51 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139
Jul 06 15:38:51 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:52 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139" returned: 0 in 0.718s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.760s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:52 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Cloning volume 337c9b72-707b-43b1-ba0c-22563496f959 to volume 55c68181-a43c-415e-8f1a-c76d78747773
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebcff9a-5351-4531-9609-d3a896483e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003723e9-b77d-4fa1-b77e-2eeccea27139', 'volume_size': 2}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad182f6-f315-45f3-8acd-b9ae15970240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Creating offline snapshot 4c264ac6-28e5-452e-a2e0-2809befc07e0 of volume 337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:38:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Volume volume-003723e9-b77d-4fa1-b77e-2eeccea27139 (003723e9-b77d-4fa1-b77e-2eeccea27139): created successfully
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad182f6-f315-45f3-8acd-b9ae15970240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Flow 'volume_create_manager' (c9c4524e-1c0a-46f8-b3a1-d6ad20261c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e18fe1a-fef8-452b-88a2-bbb14416eec2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:52 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9bfb6b4a-db5d-4ea1-9fa7-69304861104f tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Created volume successfully.
Jul 06 15:38:52 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959
Jul 06 15:38:52 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:53 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959" returned: 0 in 0.755s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:53 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 1G
Jul 06 15:38:53 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:54 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 1G" returned: 0 in 0.880s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-337c9b72-707b-43b1-ba0c-22563496f959 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:54 devstack sudo[100388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-337c9b72-707b-43b1-ba0c-22563496f959 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0
Jul 06 15:38:54 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:54 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-337c9b72-707b-43b1-ba0c-22563496f959 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0" returned: 0 in 0.713s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:54 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:38:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:55 devstack sudo[100394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0
Jul 06 15:38:55 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:55 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0" returned: 0 in 0.722s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:55 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.info
Jul 06 15:38:55 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:56 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.info" returned: 0 in 0.739s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:56 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:38:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:56 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.info
Jul 06 15:38:56 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:57 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.info" returned: 0 in 0.703s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Acquiring lock "cinder-quobyte-55c68181-a43c-415e-8f1a-c76d78747773" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Lock "cinder-quobyte-55c68181-a43c-415e-8f1a-c76d78747773" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] snapshot: 4c264ac6-28e5-452e-a2e0-2809befc07e0, volume: 55c68181-a43c-415e-8f1a-c76d78747773,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdf50a9-931b-4257-8b9d-f72f0e91705b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:57 devstack sudo[100403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0
Jul 06 15:38:57 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:58 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0" returned: 0 in 0.798s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-337c9b72-707b-43b1-ba0c-22563496f959(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:38:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:38:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:38:58 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c764727-1d7e-4cbd-958c-6da728c0a75b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:38:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:58 devstack sudo[100408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959
Jul 06 15:38:58 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:38:58 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root
Jul 06 15:38:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959" returned: 0 in 0.769s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:38:58 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773 not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:38:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:38:58 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773
Jul 06 15:38:58 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:03 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773" returned: 0 in 5.012s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:03 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14e1926-8505-4d7a-861a-6a8119c7a6b7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:04 devstack sudo[100427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959
Jul 06 15:39:04 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:04 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959" returned: 0 in 1.002s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:04 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:39:04 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Converted 1024.00 MB image at 204.26 MB/s
Jul 06 15:39:04 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 15:39:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:04 devstack sudo[100432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773
Jul 06 15:39:04 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:05 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773" returned: 0 in 0.665s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Lock "cinder-quobyte-55c68181-a43c-415e-8f1a-c76d78747773" released by "_copy_volume_from_snapshot" :: held 8.353s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Acquiring lock "cinder-quobyte-4c264ac6-28e5-452e-a2e0-2809befc07e0" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Lock "cinder-quobyte-4c264ac6-28e5-452e-a2e0-2809befc07e0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Deleting offline snapshot 4c264ac6-28e5-452e-a2e0-2809befc07e0 of volume 337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:39:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] snapshot_file for this snap is: volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:39:05 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a7a01e-e799-4a43-926f-9ce266035534]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:05 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=72,cinder:INSERT=23,cinder:UPDATE=72,cinder:DELETE=4 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:39:05 devstack sudo[100435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0
Jul 06 15:39:05 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:06 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0" returned: 0 in 0.763s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-337c9b72-707b-43b1-ba0c-22563496f959(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd10dfbf-7f49-47df-aa19-97719b1f18cf]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:06 devstack sudo[100440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959
Jul 06 15:39:06 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:06 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:39:06 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:07 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.844s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:39:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:39:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:39:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:39:07 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959" returned: 0 in 1.152s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:07 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0
Jul 06 15:39:07 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:08 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0" returned: 0 in 0.900s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:08 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0
Jul 06 15:39:08 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:09 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959.4c264ac6-28e5-452e-a2e0-2809befc07e0" returned: 0 in 0.711s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Lock "cinder-quobyte-4c264ac6-28e5-452e-a2e0-2809befc07e0" released by "_delete_snapshot" :: held 3.632s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.729s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.336s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Creating offline snapshot 268d3312-5bf9-4730-8061-73858f18a98b of volume 003723e9-b77d-4fa1-b77e-2eeccea27139 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:39:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3596f4-8cb6-4dfb-b1ff-6f9766113fc7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:09 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-073b1487-952f-4462-aca5-4e95669b40bc tempest-GroupsV314Test-549277274 None] Create group from source-group-a5549071-1b91-47f1-a9ef-a9f9a74f8ba6 completed successfully.
Jul 06 15:39:09 devstack sudo[100457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139
Jul 06 15:39:09 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:10 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139" returned: 0 in 0.806s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b 2G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:10 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b 2G
Jul 06 15:39:10 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Acquiring lock "cinder-quobyte-55c68181-a43c-415e-8f1a-c76d78747773" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Lock "cinder-quobyte-55c68181-a43c-415e-8f1a-c76d78747773" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:11 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e845718d-189b-47c3-aad4-daf275dde011]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:11 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b 2G" returned: 0 in 1.026s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-003723e9-b77d-4fa1-b77e-2eeccea27139 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:11 devstack sudo[100471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773
Jul 06 15:39:11 devstack sudo[100472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-003723e9-b77d-4fa1-b77e-2eeccea27139 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b
Jul 06 15:39:11 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:11 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:11 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-003723e9-b77d-4fa1-b77e-2eeccea27139 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b" returned: 0 in 0.744s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:11 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b is being set with open permissions: ugo+rw
Jul 06 15:39:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:11 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773" returned: 0 in 0.875s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:11 devstack sudo[100515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b
Jul 06 15:39:11 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:12 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773
Jul 06 15:39:12 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:12 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b" returned: 0 in 0.731s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:12 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55c68181-a43c-415e-8f1a-c76d78747773" returned: 0 in 0.778s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:12 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.info
Jul 06 15:39:12 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Lock "cinder-quobyte-55c68181-a43c-415e-8f1a-c76d78747773" released by "delete_volume" :: held 1.707s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:12 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Created reservations ['2df093fd-3133-4793-ad9b-3dd40b2b4e97'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:12 devstack cinder-volume[86249]: WARNING cinder.quota [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1067416068 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1067416068, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:39:12 devstack cinder-volume[86249]: WARNING cinder.quota [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1067416068 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1067416068, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:39:12 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Created reservations ['f6a3870f-3b8c-4035-bd04-ea774615baf4', '04fc2c41-3cb0-42ce-be2b-1ab8332756bb', 'f129ae10-8d9b-4867-9146-ee6bf0d38ef9', '6d94c4e0-3429-41e3-b08f-0d17bfd2b943'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:13 devstack sudo[100525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:39:13 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:13 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.info" returned: 0 in 0.663s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:13 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.info is being set with open permissions: ugo+rw
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:13 devstack sudo[100528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.info
Jul 06 15:39:13 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:13 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.677s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:39:13 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0045c9f2-54de-4322-9619-cf934aa8cc3e tempest-GroupsV314Test-549277274 None] Delete group completed successfully.
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Acquiring lock "cinder-quobyte-337c9b72-707b-43b1-ba0c-22563496f959" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Lock "cinder-quobyte-337c9b72-707b-43b1-ba0c-22563496f959" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8199a18-28b7-4009-8442-3c8d93504415]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:14 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959
Jul 06 15:39:14 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:14 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.info" returned: 0 in 0.756s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.859s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:14 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e2c18529-bd66-4da1-bfe2-559cb6cfac38 tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Create snapshot completed successfully
Jul 06 15:39:14 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959" returned: 0 in 0.826s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:14 devstack sudo[100537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959
Jul 06 15:39:14 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Acquiring lock "cinder-268d3312-5bf9-4730-8061-73858f18a98b-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "cinder-268d3312-5bf9-4730-8061-73858f18a98b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Acquiring lock "cinder-quobyte-003723e9-b77d-4fa1-b77e-2eeccea27139" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "cinder-quobyte-003723e9-b77d-4fa1-b77e-2eeccea27139" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Acquiring lock "cinder-quobyte-268d3312-5bf9-4730-8061-73858f18a98b" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "cinder-quobyte-268d3312-5bf9-4730-8061-73858f18a98b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Deleting offline snapshot 268d3312-5bf9-4730-8061-73858f18a98b of volume 003723e9-b77d-4fa1-b77e-2eeccea27139 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] snapshot_file for this snap is: volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c88689-a936-49b9-ac11-e3e7f510a7e8]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:15 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-337c9b72-707b-43b1-ba0c-22563496f959" returned: 0 in 0.752s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:15 devstack sudo[100540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b
Jul 06 15:39:15 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Lock "cinder-quobyte-337c9b72-707b-43b1-ba0c-22563496f959" released by "delete_volume" :: held 1.676s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Created reservations ['92ea3b84-57a5-4923-ba23-460c2d9f1847'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Created reservations ['7ac8f416-72cb-435f-a23d-0267fe8202e9', '4f103cc1-cfcd-48e3-9b29-c78f39c7752f', 'e6c4bc35-abb0-4c31-9bbb-2f64a239c9db', '476a0cc0-4708-4c8c-a3c1-422ad7b3694b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:15 devstack sudo[100542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:39:15 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:16 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b" returned: 0 in 0.828s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-003723e9-b77d-4fa1-b77e-2eeccea27139(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:39:16 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9728cfc-3bf4-41f0-ac81-d8e3996373fc]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:16 devstack sudo[100547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139
Jul 06 15:39:16 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:16 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.770s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:16 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:39:16 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2305ddcd-bc8c-4377-b40e-59d5609d6ee5 tempest-GroupsV314Test-549277274 None] Delete group completed successfully.
Jul 06 15:39:17 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139" returned: 0 in 1.015s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:17 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b
Jul 06 15:39:17 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:18 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b" returned: 0 in 0.914s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:18 devstack sudo[100559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b
Jul 06 15:39:18 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:18 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139.268d3312-5bf9-4730-8061-73858f18a98b" returned: 0 in 0.719s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "cinder-quobyte-268d3312-5bf9-4730-8061-73858f18a98b" released by "_delete_snapshot" :: held 3.632s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "cinder-quobyte-003723e9-b77d-4fa1-b77e-2eeccea27139" released by "delete_snapshot" :: held 3.666s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:18 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Created reservations ['ed834d9e-dcdb-4cec-b479-3867ba86a59c', 'a8444aea-28bd-40b7-836f-44f0b5a2a9a3', '9a185b77-df9b-42e0-84dc-76eab587d2ff', 'edc87d8d-ff10-4991-b77f-570217dcb693'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:19 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Delete snapshot completed successfully.
Jul 06 15:39:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36df94c1-bb7f-44fa-82a7-08a6497bf7ee tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "cinder-268d3312-5bf9-4730-8061-73858f18a98b-delete_snapshot" released by "delete_snapshot" :: held 3.862s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Acquiring lock "cinder-003723e9-b77d-4fa1-b77e-2eeccea27139-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "cinder-003723e9-b77d-4fa1-b77e-2eeccea27139-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Acquiring lock "cinder-quobyte-003723e9-b77d-4fa1-b77e-2eeccea27139" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "cinder-quobyte-003723e9-b77d-4fa1-b77e-2eeccea27139" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:19 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[493dd0a0-c013-41d2-8ba8-c6a4f8f9b734]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:19 devstack sudo[100562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139
Jul 06 15:39:19 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:20 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139" returned: 0 in 0.950s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:20 devstack sudo[100568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139
Jul 06 15:39:20 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Flow 'volume_create_manager' (9a16c9e2-1a3e-4148-9916-dd0b26367da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7ecd23-c902-41cd-8e60-5e31040aa0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7ecd23-c902-41cd-8e60-5e31040aa0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-184687265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0619ee-27c9-4941-8b50-38a9be2211cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a95e250ca246bca94a288219fdcd8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:21Z,use_quota=True,user_id='6eb4a73a83b74abbb05178029c9a8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41977847-a6af-4fcf-9099-cd4501e002bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41977847-a6af-4fcf-9099-cd4501e002bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2548f2a-cb8a-41ee-8208-7e4789f6ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2548f2a-cb8a-41ee-8208-7e4789f6ec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0619ee-27c9-4941-8b50-38a9be2211cb', 'volume_name': 'volume-cf0619ee-27c9-4941-8b50-38a9be2211cb', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c27134-911e-4ab2-9488-8e5620f672ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c27134-911e-4ab2-9488-8e5620f672ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defcb23e-407a-4be9-8d09-a68a050082a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:21 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Volume cf0619ee-27c9-4941-8b50-38a9be2211cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0619ee-27c9-4941-8b50-38a9be2211cb', 'volume_size': 1}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-184687265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0619ee-27c9-4941-8b50-38a9be2211cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a95e250ca246bca94a288219fdcd8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:21Z,use_quota=True,user_id='6eb4a73a83b74abbb05178029c9a8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Creating volume cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:21 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:39:21 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-003723e9-b77d-4fa1-b77e-2eeccea27139" returned: 0 in 0.828s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:21 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb 1073741824
Jul 06 15:39:21 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "cinder-quobyte-003723e9-b77d-4fa1-b77e-2eeccea27139" released by "delete_volume" :: held 1.861s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Created reservations ['be269864-4474-4b25-8577-8f502222b417', 'cee37424-0df5-4dfa-9814-da26c03d4d77', '537cacc5-06f7-4d72-978f-49b08dbb3724', 'a5f0cddf-1a91-481e-8f18-6fb6db5237ae'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:21 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:39:21 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:22 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb 1073741824" returned: 0 in 0.920s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:22 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.737s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:22 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:39:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Deleted volume successfully.
Jul 06 15:39:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed82590d-a45c-4444-aad8-b2b8cf48210d tempest-VolumesSnapshotNegativeTestJSON-1749132985 None] Lock "cinder-003723e9-b77d-4fa1-b77e-2eeccea27139-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:22 devstack sudo[100582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb
Jul 06 15:39:22 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:23 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb" returned: 0 in 0.712s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defcb23e-407a-4be9-8d09-a68a050082a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0619ee-27c9-4941-8b50-38a9be2211cb', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08162e70-69bd-42a1-8886-bfb8896fb737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:23 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Volume volume-cf0619ee-27c9-4941-8b50-38a9be2211cb (cf0619ee-27c9-4941-8b50-38a9be2211cb): created successfully
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08162e70-69bd-42a1-8886-bfb8896fb737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Flow 'volume_create_manager' (9a16c9e2-1a3e-4148-9916-dd0b26367da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:39:23 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-194c0977-92ae-4b71-8562-2c2eff4d50fa tempest-SnapshotDependencyTests-1288663576 None] Created volume successfully.
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Creating offline snapshot ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 of volume cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5cb829-c047-4fb7-b0e2-6580641df94d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:23 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb
Jul 06 15:39:23 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:24 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb" returned: 0 in 0.916s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:24 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 1G
Jul 06 15:39:24 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:25 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 1G" returned: 0 in 1.026s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf0619ee-27c9-4941-8b50-38a9be2211cb -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:25 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf0619ee-27c9-4941-8b50-38a9be2211cb -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5
Jul 06 15:39:25 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:26 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf0619ee-27c9-4941-8b50-38a9be2211cb -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5" returned: 0 in 0.762s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:26 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 is being set with open permissions: ugo+rw
Jul 06 15:39:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:26 devstack sudo[100607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5
Jul 06 15:39:26 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:27 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5" returned: 0 in 0.734s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:27 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=131,cinder:DELETE=4,cinder:SELECT=94,cinder:INSERT=27 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:39:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:27 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.info
Jul 06 15:39:27 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:27 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.info" returned: 0 in 0.741s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:27 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.info is being set with open permissions: ugo+rw
Jul 06 15:39:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:27 devstack sudo[100613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.info
Jul 06 15:39:27 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:28 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.info" returned: 0 in 0.790s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.070s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:28 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c3005e8a-3947-4a9a-85f2-dfa4d798e906 tempest-SnapshotDependencyTests-1288663576 None] Create snapshot completed successfully
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Flow 'volume_create_manager' (f8098d10-89da-438b-802a-97071641ad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7d7186-5fac-40aa-8bc9-87f8361fa362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7d7186-5fac-40aa-8bc9-87f8361fa362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=785cfe8c-3ebd-472f-a6bd-70f4c1ce84be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a95e250ca246bca94a288219fdcd8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ab78bc22-6d52-4363-b7c2-4ac0aa6664f5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:30Z,use_quota=True,user_id='6eb4a73a83b74abbb05178029c9a8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179adc86-8668-4329-8682-76a4a2101ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179adc86-8668-4329-8682-76a4a2101ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6aaac8f-cece-4cc3-94f1-5c707133a6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6aaac8f-cece-4cc3-94f1-5c707133a6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '785cfe8c-3ebd-472f-a6bd-70f4c1ce84be', 'volume_name': 'volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be', 'volume_size': 1, 'snapshot_id': 'ab78bc22-6d52-4363-b7c2-4ac0aa6664f5'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a809ad-7da3-4c13-91b8-d8108734eff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a809ad-7da3-4c13-91b8-d8108734eff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c192304f-db85-44d8-83ca-7fdb9f9cac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:29 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Volume 785cfe8c-3ebd-472f-a6bd-70f4c1ce84be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be', 'volume_size': 1, 'snapshot_id': 'ab78bc22-6d52-4363-b7c2-4ac0aa6664f5'}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "cinder-quobyte-ab78bc22-6d52-4363-b7c2-4ac0aa6664f5-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" by "_create_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-ab78bc22-6d52-4363-b7c2-4ac0aa6664f5-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Creating volume 785cfe8c-3ebd-472f-a6bd-70f4c1ce84be from snapshot ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 {{(pid=86249) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:39:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "cinder-quobyte-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] snapshot: ab78bc22-6d52-4363-b7c2-4ac0aa6664f5, volume: 785cfe8c-3ebd-472f-a6bd-70f4c1ce84be,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d82450-bfcf-4525-a587-b5a9f4f0b31b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:30 devstack sudo[100617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5
Jul 06 15:39:30 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:30 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5" returned: 0 in 0.858s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf0619ee-27c9-4941-8b50-38a9be2211cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca78780-adec-4726-87a1-98758a6a81a2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:31 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb
Jul 06 15:39:31 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Flow 'volume_create_manager' (216c3619-fc02-4075-8243-ca8b3dc46122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960f02dd-49c1-4e5d-99d3-132c2f572cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960f02dd-49c1-4e5d-99d3-132c2f572cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-319180381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e565bb-0179-4e68-a772-15b0edf683fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f458e794b2840578dcfe102c329481a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:32Z,use_quota=True,user_id='11c36ef04e5648068df39d0a4084edb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e20517f-10fa-4db9-801c-4a996e70d88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e20517f-10fa-4db9-801c-4a996e70d88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:31 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc73b482-01d6-4ba7-9a52-9912fddd6991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc73b482-01d6-4ba7-9a52-9912fddd6991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e565bb-0179-4e68-a772-15b0edf683fd', 'volume_name': 'volume-25e565bb-0179-4e68-a772-15b0edf683fd', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ece577a-bfc7-4a29-b370-7c8c92f9aef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ece577a-bfc7-4a29-b370-7c8c92f9aef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b01026-a750-46c0-aeb6-5b24b1f23bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:31 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Volume 25e565bb-0179-4e68-a772-15b0edf683fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e565bb-0179-4e68-a772-15b0edf683fd', 'volume_size': 1}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb" returned: 0 in 0.874s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:39:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:31 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be
Jul 06 15:39:31 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:37 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" returned: 0 in 5.317s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:37 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b9cb54-9ffe-42a5-b3a2-43ff70df130b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:37 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb
Jul 06 15:39:37 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:38 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb" returned: 0 in 0.965s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:39:38 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Converted 1024.00 MB image at 192.57 MB/s
Jul 06 15:39:38 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be is being set with open permissions: ugo+rw
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:38 devstack sudo[100645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be
Jul 06 15:39:38 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:38 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" returned: 0 in 0.657s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" released by "_copy_volume_from_snapshot" :: held 8.794s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-ab78bc22-6d52-4363-b7c2-4ac0aa6664f5-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" released by "_create_volume_from_snapshot" :: held 8.832s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.857s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.989s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-319180381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e565bb-0179-4e68-a772-15b0edf683fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f458e794b2840578dcfe102c329481a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:32Z,use_quota=True,user_id='11c36ef04e5648068df39d0a4084edb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Creating volume 25e565bb-0179-4e68-a772-15b0edf683fd {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:39:38 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:38 devstack sudo[100648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd 1073741824
Jul 06 15:39:38 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c192304f-db85-44d8-83ca-7fdb9f9cac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be', 'volume_size': 1, 'snapshot_id': 'ab78bc22-6d52-4363-b7c2-4ac0aa6664f5'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca36a41f-4307-4e12-b08f-3af0fdf9b2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:38 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Volume volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be (785cfe8c-3ebd-472f-a6bd-70f4c1ce84be): created successfully
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca36a41f-4307-4e12-b08f-3af0fdf9b2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Flow 'volume_create_manager' (f8098d10-89da-438b-802a-97071641ad93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:39:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-87488a10-84a1-4986-a7d4-fe3183c40bb9 tempest-SnapshotDependencyTests-1288663576 None] Created volume successfully.
Jul 06 15:39:39 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd 1073741824" returned: 0 in 0.933s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "cinder-ab78bc22-6d52-4363-b7c2-4ac0aa6664f5-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:39 devstack sudo[100655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd
Jul 06 15:39:39 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-ab78bc22-6d52-4363-b7c2-4ac0aa6664f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "cinder-quobyte-cf0619ee-27c9-4941-8b50-38a9be2211cb" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-cf0619ee-27c9-4941-8b50-38a9be2211cb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "cinder-quobyte-ab78bc22-6d52-4363-b7c2-4ac0aa6664f5" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-ab78bc22-6d52-4363-b7c2-4ac0aa6664f5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Deleting offline snapshot ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 of volume cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] snapshot_file for this snap is: volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ecc1c7-77dc-4e1a-a7d0-98a74a490c6d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:40 devstack sudo[100657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5
Jul 06 15:39:40 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:40 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd" returned: 0 in 0.731s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b01026-a750-46c0-aeb6-5b24b1f23bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e565bb-0179-4e68-a772-15b0edf683fd', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d342a63d-afb5-4dbe-9b6b-1b6a74cc727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:40 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Volume volume-25e565bb-0179-4e68-a772-15b0edf683fd (25e565bb-0179-4e68-a772-15b0edf683fd): created successfully
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d342a63d-afb5-4dbe-9b6b-1b6a74cc727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Flow 'volume_create_manager' (216c3619-fc02-4075-8243-ca8b3dc46122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:39:40 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c4fd8d82-9383-4603-bfbb-e3d3173c121f tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Created volume successfully.
Jul 06 15:39:40 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5" returned: 0 in 0.868s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf0619ee-27c9-4941-8b50-38a9be2211cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a78587-24c4-4464-9ed6-2aad473cb904]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:40 devstack sudo[100664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb
Jul 06 15:39:40 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:41 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb" returned: 0 in 0.768s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:41 devstack sudo[100669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5
Jul 06 15:39:41 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:42 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5" returned: 0 in 0.964s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:42 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5
Jul 06 15:39:42 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Acquiring lock "cinder-25e565bb-0179-4e68-a772-15b0edf683fd-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Lock "cinder-25e565bb-0179-4e68-a772-15b0edf683fd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Acquiring lock "cinder-quobyte-25e565bb-0179-4e68-a772-15b0edf683fd" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Lock "cinder-quobyte-25e565bb-0179-4e68-a772-15b0edf683fd" acquired by "delete_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:42 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[afda4709-af39-4b5b-ad94-3fa2f2026899]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:43 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd
Jul 06 15:39:43 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:43 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb.ab78bc22-6d52-4363-b7c2-4ac0aa6664f5" returned: 0 in 0.907s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-ab78bc22-6d52-4363-b7c2-4ac0aa6664f5" released by "_delete_snapshot" :: held 3.660s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-cf0619ee-27c9-4941-8b50-38a9be2211cb" released by "delete_snapshot" :: held 3.691s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:43 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Created reservations ['d7e1b8d2-8ca6-4002-9e43-f4e09f9babf9', '3e9c26b3-5bca-489f-ad19-a34d2470c584', '79c06842-1842-4229-8c1a-d56f5b9131a7', '37a51821-e063-454c-9f9c-947c2978352a'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Delete snapshot completed successfully.
Jul 06 15:39:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6f7fc2b0-938f-4f7d-b7e5-05a6445d757e tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-ab78bc22-6d52-4363-b7c2-4ac0aa6664f5-delete_snapshot" released by "delete_snapshot" :: held 3.928s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:43 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd" returned: 0 in 0.904s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:43 devstack sudo[100682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd
Jul 06 15:39:43 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "cinder-cf0619ee-27c9-4941-8b50-38a9be2211cb-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-cf0619ee-27c9-4941-8b50-38a9be2211cb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "cinder-quobyte-cf0619ee-27c9-4941-8b50-38a9be2211cb" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-cf0619ee-27c9-4941-8b50-38a9be2211cb" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7da270f-4158-48b4-9f55-6579ae3218cf]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:44 devstack sudo[100684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb
Jul 06 15:39:44 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:44 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-25e565bb-0179-4e68-a772-15b0edf683fd" returned: 0 in 0.864s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Lock "cinder-quobyte-25e565bb-0179-4e68-a772-15b0edf683fd" released by "delete_volume" :: held 1.855s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Created reservations ['29ded33b-bb6e-4510-b400-dbfd92d874a4', 'e839f525-9aa3-432f-9453-52b34b548185', 'ce546fe4-2b11-4e3f-826f-308112269304', '8af990df-2c12-4fdd-a2e5-8cf47ce48fb8'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:44 devstack sudo[100687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:39:44 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:45 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb" returned: 0 in 1.026s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:45 devstack sudo[100692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb
Jul 06 15:39:45 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:46 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.230s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:39:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Deleted volume successfully.
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6dab65ee-b3da-4862-b6ba-333af4e78175 tempest-VolumeQuotasNegativeTestJSON-1954425533 None] Lock "cinder-25e565bb-0179-4e68-a772-15b0edf683fd-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cf0619ee-27c9-4941-8b50-38a9be2211cb" returned: 0 in 1.001s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:46 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-cf0619ee-27c9-4941-8b50-38a9be2211cb" released by "delete_volume" :: held 2.180s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Created reservations ['9a2922ab-6a35-44f3-bc95-8c239d8a8bb0', '0475bb3d-dfed-4e90-873b-53ec5d99aae4', 'e1ed0934-d16b-4f21-8658-f7180e6a35ec', 'efb69ac7-0266-4ec1-b452-456af758ee85'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:46 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:39:46 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:47 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.693s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:47 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:39:47 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Deleted volume successfully.
Jul 06 15:39:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de965dae-d962-4a43-8b3b-a76a4946483b tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-cf0619ee-27c9-4941-8b50-38a9be2211cb-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "cinder-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "cinder-quobyte-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:47 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[98104034-da39-4526-ac70-453f5889e1ae]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:47 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be
Jul 06 15:39:47 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:48 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" returned: 0 in 0.877s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:48 devstack sudo[100705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be
Jul 06 15:39:48 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:49 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" returned: 0 in 0.752s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-quobyte-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be" released by "delete_volume" :: held 1.685s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:49 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Created reservations ['102760b7-a511-4f4a-b71d-f40b97c13478', '69074af2-4e4a-4d77-abfa-1d2a9935f9f5', 'c5fb5e17-446a-4d44-8f23-747ae7288e61', '7e4a296a-0cc3-404d-ad54-97ad88647bfc'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:49 devstack sudo[100708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:39:49 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:50 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.836s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:50 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:39:50 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Deleted volume successfully.
Jul 06 15:39:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-dd49e2d8-54f4-4b8c-a68d-210c8ac682f3 tempest-SnapshotDependencyTests-1288663576 None] Lock "cinder-785cfe8c-3ebd-472f-a6bd-70f4c1ce84be-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Flow 'volume_create_manager' (bf9c5344-216e-488c-aba6-0c52a84a4912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a64cc1-d4fc-4a78-ae83-e0bb5f0ed171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a64cc1-d4fc-4a78-ae83-e0bb5f0ed171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-802434508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33fd903-d08e-4fc8-b127-4770a6acc49a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a2623b9bc445719ef3693b09b4a65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:52Z,use_quota=True,user_id='19d73fb7015148cd9be55ae87e50c774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d5f13ce-9555-4602-b6a5-53180f6da5ac),volume_type_id=1d5f13ce-9555-4602-b6a5-53180f6da5ac)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ad9e86-124b-4da8-a049-460c405d8ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ad9e86-124b-4da8-a049-460c405d8ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294afb80-46bb-47d1-b84a-b3024a1a42c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294afb80-46bb-47d1-b84a-b3024a1a42c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33fd903-d08e-4fc8-b127-4770a6acc49a', 'volume_name': 'volume-c33fd903-d08e-4fc8-b127-4770a6acc49a', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697ada7b-c8c1-4d38-95e9-72200fe9ad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697ada7b-c8c1-4d38-95e9-72200fe9ad11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5454e742-a52c-4369-b449-d72a2db8c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Volume c33fd903-d08e-4fc8-b127-4770a6acc49a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33fd903-d08e-4fc8-b127-4770a6acc49a', 'volume_size': 1}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-802434508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33fd903-d08e-4fc8-b127-4770a6acc49a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a2623b9bc445719ef3693b09b4a65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:52Z,use_quota=True,user_id='19d73fb7015148cd9be55ae87e50c774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d5f13ce-9555-4602-b6a5-53180f6da5ac),volume_type_id=1d5f13ce-9555-4602-b6a5-53180f6da5ac)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Creating volume c33fd903-d08e-4fc8-b127-4770a6acc49a {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:39:52 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:39:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:52 devstack sudo[100716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a 1073741824
Jul 06 15:39:52 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:53 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a 1073741824" returned: 0 in 0.889s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:53 devstack sudo[100723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a
Jul 06 15:39:53 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:54 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a" returned: 0 in 0.748s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5454e742-a52c-4369-b449-d72a2db8c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33fd903-d08e-4fc8-b127-4770a6acc49a', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537f46e6-2585-41e7-8b7c-f6449847653d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:39:54 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Volume volume-c33fd903-d08e-4fc8-b127-4770a6acc49a (c33fd903-d08e-4fc8-b127-4770a6acc49a): created successfully
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537f46e6-2585-41e7-8b7c-f6449847653d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Flow 'volume_create_manager' (bf9c5344-216e-488c-aba6-0c52a84a4912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:39:54 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fcf4405c-2abe-4350-976e-db86bef0df46 tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Created volume successfully.
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2520fd00-c7bc-4b05-9be9-1749e728925b tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2520fd00-c7bc-4b05-9be9-1749e728925b tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2520fd00-c7bc-4b05-9be9-1749e728925b tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2520fd00-c7bc-4b05-9be9-1749e728925b tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2520fd00-c7bc-4b05-9be9-1749e728925b tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2520fd00-c7bc-4b05-9be9-1749e728925b tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:54 devstack sudo[100727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:39:54 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:55 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2520fd00-c7bc-4b05-9be9-1749e728925b tempest-VolumeRetypeWithoutMigrationTest-245785315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.661s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:55 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-2520fd00-c7bc-4b05-9be9-1749e728925b tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:39:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2520fd00-c7bc-4b05-9be9-1749e728925b tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Retype volume completed successfully.
Jul 06 15:39:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Acquiring lock "cinder-c33fd903-d08e-4fc8-b127-4770a6acc49a-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "cinder-c33fd903-d08e-4fc8-b127-4770a6acc49a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Acquiring lock "cinder-quobyte-c33fd903-d08e-4fc8-b127-4770a6acc49a" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:39:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "cinder-quobyte-c33fd903-d08e-4fc8-b127-4770a6acc49a" acquired by "delete_volume" :: waited 0.013s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:39:56 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3824771a-9f63-488e-8547-e3681cb07b88]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:39:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:56 devstack sudo[100730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a
Jul 06 15:39:56 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:57 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a" returned: 0 in 0.892s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:57 devstack sudo[100736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a
Jul 06 15:39:57 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:57 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c33fd903-d08e-4fc8-b127-4770a6acc49a" returned: 0 in 0.709s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "cinder-quobyte-c33fd903-d08e-4fc8-b127-4770a6acc49a" released by "delete_volume" :: held 1.659s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:39:57 devstack cinder-volume[86249]: WARNING cinder.quota [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:39:57 devstack cinder-volume[86249]: WARNING cinder.quota [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Created reservations ['c65af501-5fbe-4668-af75-a474f4d61309', '5e362dbb-c12c-4be2-9253-5ff3d6d697a6', 'd245b49b-faca-4a54-a8b7-80a872705918', '3d9d7a43-a3fa-4a69-9542-e717f3505d20'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:39:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:39:57 devstack sudo[100739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:39:57 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:39:59 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root
Jul 06 15:39:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.154s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:39:59 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:39:59 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Deleted volume successfully.
Jul 06 15:39:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f426a19b-28a0-4e04-b522-38aefa5480eb tempest-VolumeRetypeWithoutMigrationTest-245785315 None] Lock "cinder-c33fd903-d08e-4fc8-b127-4770a6acc49a-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:40:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:40:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:40:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:40:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:40:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:40:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:40:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:40:06 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:40:06 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:40:07 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Jul 06 15:40:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.840s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:40:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:40:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:40:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:40:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:40:07 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=54,cinder:DELETE=5,cinder:SELECT=36,cinder:INSERT=11 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=83,cinder:UPDATE=89,cinder:INSERT=24,cinder:DELETE=6 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Flow 'volume_create_manager' (ea212cda-9cdf-4b35-bc1f-85201c071e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e23a5f-0c5d-4083-b8be-bb856e518d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e23a5f-0c5d-4083-b8be-bb856e518d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-522547631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775367dd338d46b1962a7e463bd8a8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:08Z,use_quota=True,user_id='68275ae89009480f8a59a7d577641069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f031f8-fed0-4f8e-8ad1-c47da6db2751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f031f8-fed0-4f8e-8ad1-c47da6db2751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffe9505-a0fa-4782-bb78-ebb4ec7a2b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffe9505-a0fa-4782-bb78-ebb4ec7a2b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225', 'volume_name': 'volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d09eff9-0b5e-4a5e-bad9-7dca7585d567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d09eff9-0b5e-4a5e-bad9-7dca7585d567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c0e104-b8bd-4501-9e47-4209bdabc367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:08 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Volume 438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225', 'volume_size': 1}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-522547631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775367dd338d46b1962a7e463bd8a8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:08Z,use_quota=True,user_id='68275ae89009480f8a59a7d577641069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Creating volume 438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:40:08 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:40:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:40:08 devstack sudo[100849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225 1073741824
Jul 06 15:40:08 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:40:09 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root
Jul 06 15:40:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225 1073741824" returned: 0 in 0.971s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:40:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:40:09 devstack sudo[100856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225
Jul 06 15:40:09 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:40:10 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root
Jul 06 15:40:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225" returned: 0 in 0.695s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:40:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:40:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:40:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c0e104-b8bd-4501-9e47-4209bdabc367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed881f2-943f-44af-b5ef-01a7308bb01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:10 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Volume volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225 (438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225): created successfully
Jul 06 15:40:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed881f2-943f-44af-b5ef-01a7308bb01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Flow 'volume_create_manager' (ea212cda-9cdf-4b35-bc1f-85201c071e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:40:10 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d09ea639-429a-48b2-9b67-92db02bbe39b tempest-TestMinimumBasicScenario-2138757572 None] Created volume successfully.
Jul 06 15:40:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-ed856823-a422-4844-9230-2a6744d66163 req-f903e8c2-b61b-4246-934e-2b5a37bf49bf tempest-TestMinimumBasicScenario-2138757572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:40:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-ed856823-a422-4844-9230-2a6744d66163 req-f903e8c2-b61b-4246-934e-2b5a37bf49bf tempest-TestMinimumBasicScenario-2138757572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:40:13 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[87236b6b-07df-4fe9-81ce-4e8b6347c026]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:40:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-ed856823-a422-4844-9230-2a6744d66163 req-f903e8c2-b61b-4246-934e-2b5a37bf49bf tempest-TestMinimumBasicScenario-2138757572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:40:14 devstack sudo[100907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225
Jul 06 15:40:14 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:40:14 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root
Jul 06 15:40:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-ed856823-a422-4844-9230-2a6744d66163 req-f903e8c2-b61b-4246-934e-2b5a37bf49bf tempest-TestMinimumBasicScenario-2138757572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225" returned: 0 in 0.983s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:40:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-ed856823-a422-4844-9230-2a6744d66163 req-f903e8c2-b61b-4246-934e-2b5a37bf49bf tempest-TestMinimumBasicScenario-2138757572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:40:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-ed856823-a422-4844-9230-2a6744d66163 req-f903e8c2-b61b-4246-934e-2b5a37bf49bf tempest-TestMinimumBasicScenario-2138757572 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b9ec5ea-8a20-4fcd-a6ac-2fbb19a25edd', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:40:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-ed856823-a422-4844-9230-2a6744d66163 req-f903e8c2-b61b-4246-934e-2b5a37bf49bf tempest-TestMinimumBasicScenario-2138757572 None] attachment_update completed successfully.
Jul 06 15:40:25 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:40:25 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (50d201f2-7a19-43f7-92f9-978363632a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d582541d-bdb6-4202-8c29-f0d60f7d8c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d582541d-bdb6-4202-8c29-f0d60f7d8c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-570804218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a306e6a-ce61-413a-88e8-8375ef386413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:45Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa0b081-3006-4834-b2f3-22a65e182aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa0b081-3006-4834-b2f3-22a65e182aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f2487f-4b63-44f5-b31d-055d39281e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f2487f-4b63-44f5-b31d-055d39281e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a306e6a-ce61-413a-88e8-8375ef386413', 'volume_name': 'volume-6a306e6a-ce61-413a-88e8-8375ef386413', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f67b58-48d1-418a-8720-017141e51f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f67b58-48d1-418a-8720-017141e51f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f856d5-4bde-41fa-890c-55d58536ae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:44 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Volume 6a306e6a-ce61-413a-88e8-8375ef386413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a306e6a-ce61-413a-88e8-8375ef386413', 'volume_size': 1}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-570804218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a306e6a-ce61-413a-88e8-8375ef386413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:45Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Creating volume 6a306e6a-ce61-413a-88e8-8375ef386413 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:40:44 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:40:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:40:44 devstack sudo[101490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413 1073741824
Jul 06 15:40:44 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:40:45 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root
Jul 06 15:40:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413 1073741824" returned: 0 in 0.915s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:40:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:40:45 devstack sudo[101496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413
Jul 06 15:40:45 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:40:46 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root
Jul 06 15:40:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413" returned: 0 in 0.636s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:40:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:40:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:40:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f856d5-4bde-41fa-890c-55d58536ae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a306e6a-ce61-413a-88e8-8375ef386413', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5b7021-efcb-4a56-83e2-74a2438dd21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:46 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Volume volume-6a306e6a-ce61-413a-88e8-8375ef386413 (6a306e6a-ce61-413a-88e8-8375ef386413): created successfully
Jul 06 15:40:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5b7021-efcb-4a56-83e2-74a2438dd21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (50d201f2-7a19-43f7-92f9-978363632a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:40:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7aff25c8-99d4-47c4-b5af-589f4b83ad3f tempest-VolumesActionsTest-608482758 None] Created volume successfully.
Jul 06 15:40:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d12f8356-3342-4dde-9378-bd35c1c321f7 tempest-VolumesActionsTest-608482758 None] Acquiring lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413" by "attach_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:40:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d12f8356-3342-4dde-9378-bd35c1c321f7 tempest-VolumesActionsTest-608482758 None] Lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413" acquired by "attach_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:40:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d12f8356-3342-4dde-9378-bd35c1c321f7 tempest-VolumesActionsTest-608482758 None] Attaching volume 6a306e6a-ce61-413a-88e8-8375ef386413 to instance c46992b3-02d5-456c-a1b6-c75e6d2a6e55 at mountpoint /dev/vdb on host None.
Jul 06 15:40:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d12f8356-3342-4dde-9378-bd35c1c321f7 tempest-VolumesActionsTest-608482758 None] Attach volume completed successfully.
Jul 06 15:40:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d12f8356-3342-4dde-9378-bd35c1c321f7 tempest-VolumesActionsTest-608482758 None] Lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413" released by "attach_volume" :: held 0.103s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:40:47 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1e14e668-87be-480c-8300-f0fa0eed2bca tempest-VolumesActionsTest-2017336561 None] Terminate volume connection completed successfully.
Jul 06 15:40:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1e14e668-87be-480c-8300-f0fa0eed2bca tempest-VolumesActionsTest-2017336561 None] Acquiring lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413-detach_volume" by "detach_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:40:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1e14e668-87be-480c-8300-f0fa0eed2bca tempest-VolumesActionsTest-2017336561 None] Lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:40:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1e14e668-87be-480c-8300-f0fa0eed2bca tempest-VolumesActionsTest-2017336561 None] Detaching volume 6a306e6a-ce61-413a-88e8-8375ef386413 from instance c46992b3-02d5-456c-a1b6-c75e6d2a6e55.
Jul 06 15:40:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1e14e668-87be-480c-8300-f0fa0eed2bca tempest-VolumesActionsTest-2017336561 None] Detach volume completed successfully.
Jul 06 15:40:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1e14e668-87be-480c-8300-f0fa0eed2bca tempest-VolumesActionsTest-2017336561 None] Lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:40:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8e5b1d8a-950d-4f30-8de4-08c9a8d88e58 tempest-VolumesActionsTest-608482758 None] Acquiring lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413-detach_volume" by "detach_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:40:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8e5b1d8a-950d-4f30-8de4-08c9a8d88e58 tempest-VolumesActionsTest-608482758 None] Lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:40:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8e5b1d8a-950d-4f30-8de4-08c9a8d88e58 tempest-VolumesActionsTest-608482758 None] Volume detach called, but volume not attached.
Jul 06 15:40:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8e5b1d8a-950d-4f30-8de4-08c9a8d88e58 tempest-VolumesActionsTest-608482758 None] Lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:40:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Acquiring lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:40:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:40:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Acquiring lock "cinder-quobyte-6a306e6a-ce61-413a-88e8-8375ef386413" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:40:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Lock "cinder-quobyte-6a306e6a-ce61-413a-88e8-8375ef386413" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:40:49 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85cc917-5e13-42b3-8f9e-29a55d8a9e4e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:40:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:40:49 devstack sudo[101499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413
Jul 06 15:40:49 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:40:50 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root
Jul 06 15:40:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413" returned: 0 in 0.795s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:40:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:40:50 devstack sudo[101506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413
Jul 06 15:40:50 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:40:51 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root
Jul 06 15:40:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-6a306e6a-ce61-413a-88e8-8375ef386413" returned: 0 in 0.773s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:40:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Lock "cinder-quobyte-6a306e6a-ce61-413a-88e8-8375ef386413" released by "delete_volume" :: held 1.619s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:40:51 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Created reservations ['065cab50-3e1f-4e75-80c6-9047f269e77a', 'ee3ef9d0-54b6-4d80-8fe2-598c67eb3094', '0449b733-deb2-47f4-bacf-f5057cf2caf0', '0a4882b5-6472-4b71-b59c-7497a0c7cb22'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:40:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:40:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:40:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:40:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:40:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:40:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:40:51 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:40:51 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:40:52 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Jul 06 15:40:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.786s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:40:52 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:40:52 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Deleted volume successfully.
Jul 06 15:40:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c177dc2b-5bdf-44f6-b875-fbb300c488b9 tempest-VolumesActionsTest-608482758 None] Lock "cinder-6a306e6a-ce61-413a-88e8-8375ef386413-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:40:59 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:40:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (6c494813-9673-4a9f-a989-42e5f5494491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:40:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050e2067-6c25-4dfe-99ee-c1be40d88dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:40:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050e2067-6c25-4dfe-99ee-c1be40d88dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-946072452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad89fdc4-e30c-4bea-9249-840f8b3024a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:00Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:40:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2baf3ce-82e5-4252-8616-2ee829d2094c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2baf3ce-82e5-4252-8616-2ee829d2094c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d124d16-d060-4014-83cb-6d02e54fa8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d124d16-d060-4014-83cb-6d02e54fa8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad89fdc4-e30c-4bea-9249-840f8b3024a3', 'volume_name': 'volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db77be47-da52-4dc0-befc-af3463c0a0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db77be47-da52-4dc0-befc-af3463c0a0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce48ccc-1937-49b2-b085-2b0ee5964a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:00 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Volume ad89fdc4-e30c-4bea-9249-840f8b3024a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3', 'volume_size': 1}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-946072452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad89fdc4-e30c-4bea-9249-840f8b3024a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:00Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Creating volume ad89fdc4-e30c-4bea-9249-840f8b3024a3 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:41:00 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:00 devstack sudo[101538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3 1073741824
Jul 06 15:41:00 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:00 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3 1073741824" returned: 0 in 0.908s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:01 devstack sudo[101544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3
Jul 06 15:41:01 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:01 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3" returned: 0 in 0.715s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:41:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce48ccc-1937-49b2-b085-2b0ee5964a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7445684-80f5-4d22-9e8a-bb877613cfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:01 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Volume volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3 (ad89fdc4-e30c-4bea-9249-840f8b3024a3): created successfully
Jul 06 15:41:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7445684-80f5-4d22-9e8a-bb877613cfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (6c494813-9673-4a9f-a989-42e5f5494491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:01 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-37f4ab88-0b56-4ff4-b39b-c84d41bc86e7 tempest-VolumesActionsTest-608482758 None] Created volume successfully.
Jul 06 15:41:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Acquiring lock "cinder-ad89fdc4-e30c-4bea-9249-840f8b3024a3-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Lock "cinder-ad89fdc4-e30c-4bea-9249-840f8b3024a3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Acquiring lock "cinder-quobyte-ad89fdc4-e30c-4bea-9249-840f8b3024a3" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Lock "cinder-quobyte-ad89fdc4-e30c-4bea-9249-840f8b3024a3" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:02 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e64558-fce4-47ba-81ab-8ac02bdad5cc]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:02 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3
Jul 06 15:41:02 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:03 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3" returned: 0 in 0.756s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:03 devstack sudo[101556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3
Jul 06 15:41:03 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:03 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad89fdc4-e30c-4bea-9249-840f8b3024a3" returned: 0 in 0.680s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Lock "cinder-quobyte-ad89fdc4-e30c-4bea-9249-840f8b3024a3" released by "delete_volume" :: held 1.476s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Created reservations ['86be921d-4df7-4e3d-adba-0cc3d03d7d06', 'a3614c60-680b-4891-ab01-2a8f47352e28', '953eaf82-5b7b-43ac-bc3a-4788e1eedca5', '3cb47500-cac3-4242-be74-9c50f579f310'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:03 devstack sudo[101559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:41:03 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:04 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.860s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:04 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:41:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Deleted volume successfully.
Jul 06 15:41:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe7018f3-7d52-4862-80a1-9ad4bfe1806b tempest-VolumesActionsTest-2017336561 None] Lock "cinder-ad89fdc4-e30c-4bea-9249-840f8b3024a3-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (ab7ebe44-3495-47c8-882d-cca35683dd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eeb0a1d-8238-4a8d-a7f0-b0908a255082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eeb0a1d-8238-4a8d-a7f0-b0908a255082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666534694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55bd4eb5-02cf-4955-be26-6e7cde69e2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:05Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18b3ec3-95d5-492c-b2ae-371e8c75aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18b3ec3-95d5-492c-b2ae-371e8c75aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e428d9c-46cc-49ca-a0c5-b9b92a504a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e428d9c-46cc-49ca-a0c5-b9b92a504a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55bd4eb5-02cf-4955-be26-6e7cde69e2ad', 'volume_name': 'volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ea6fed-cc71-48da-b616-fb270875124d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ea6fed-cc71-48da-b616-fb270875124d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceda2366-ae84-47cb-af69-5714a586bf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:05 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Volume 55bd4eb5-02cf-4955-be26-6e7cde69e2ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad', 'volume_size': 1}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666534694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55bd4eb5-02cf-4955-be26-6e7cde69e2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:05Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Creating volume 55bd4eb5-02cf-4955-be26-6e7cde69e2ad {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:41:05 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:41:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:05 devstack sudo[101564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad 1073741824
Jul 06 15:41:05 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:06 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad 1073741824" returned: 0 in 0.937s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:06 devstack sudo[101572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad
Jul 06 15:41:06 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:06 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:41:06 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:06 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad" returned: 0 in 0.653s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceda2366-ae84-47cb-af69-5714a586bf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6875ffd-1994-4d22-b0e5-b997b3ac6128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:06 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Volume volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad (55bd4eb5-02cf-4955-be26-6e7cde69e2ad): created successfully
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6875ffd-1994-4d22-b0e5-b997b3ac6128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (ab7ebe44-3495-47c8-882d-cca35683dd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:06 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bee709e3-5c39-4678-8a1b-058546b8be9c tempest-VolumesActionsTest-608482758 None] Created volume successfully.
Jul 06 15:41:07 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-81400a37-3c8c-464c-9d9d-113abda286fa req-4912491b-caab-4579-95e7-e374971b72d0 tempest-TestMinimumBasicScenario-2138757572 None] Terminate volume connection completed successfully.
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-81400a37-3c8c-464c-9d9d-113abda286fa req-4912491b-caab-4579-95e7-e374971b72d0 tempest-TestMinimumBasicScenario-2138757572 None] Deleting attachment 8b9ec5ea-8a20-4fcd-a6ac-2fbb19a25edd. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Acquiring lock "cinder-55bd4eb5-02cf-4955-be26-6e7cde69e2ad-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Lock "cinder-55bd4eb5-02cf-4955-be26-6e7cde69e2ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Acquiring lock "cinder-quobyte-55bd4eb5-02cf-4955-be26-6e7cde69e2ad" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Lock "cinder-quobyte-55bd4eb5-02cf-4955-be26-6e7cde69e2ad" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:07 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.830s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc4098a-87e2-426c-8159-fab394e07956]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:07 devstack sudo[101582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad
Jul 06 15:41:07 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:08 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad" returned: 0 in 0.786s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:08 devstack sudo[101587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad
Jul 06 15:41:08 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:08 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55bd4eb5-02cf-4955-be26-6e7cde69e2ad" returned: 0 in 0.666s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Lock "cinder-quobyte-55bd4eb5-02cf-4955-be26-6e7cde69e2ad" released by "delete_volume" :: held 1.496s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Created reservations ['3b5b5edd-dda7-444f-9627-e67787241703', 'b34bfd9b-7712-4c26-8f23-bf424578f0e3', 'ca80d0cf-4cfe-4564-a14a-24c59c101b88', '7d9370ab-1a47-40fe-9eb0-ac1a45c9122c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:09 devstack sudo[101590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:41:09 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Acquiring lock "cinder-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Lock "cinder-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Acquiring lock "cinder-quobyte-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Lock "cinder-quobyte-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8abd92-42bd-4c78-899a-8b3952ee2652]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:09 devstack sudo[101592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225
Jul 06 15:41:09 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:09 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.691s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:41:09 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Deleted volume successfully.
Jul 06 15:41:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b3239311-f82f-45ef-bbe0-cf03df241ae3 tempest-VolumesActionsTest-2017336561 None] Lock "cinder-55bd4eb5-02cf-4955-be26-6e7cde69e2ad-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:10 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225" returned: 0 in 0.854s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:41:10 devstack sudo[101601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225
Jul 06 15:41:10 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (0cce807f-a694-44fb-8cab-feabdf26d811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477fa772-070d-412d-9eb7-a67dbdcc0cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477fa772-070d-412d-9eb7-a67dbdcc0cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1316551917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f3fe2a-b0f6-4f2c-a277-d938f23da229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:10Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c461a14-2b89-4d36-a956-dcbdae0af19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c461a14-2b89-4d36-a956-dcbdae0af19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ad930c-8628-47c0-ab51-2e3f00d658de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ad930c-8628-47c0-ab51-2e3f00d658de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f3fe2a-b0f6-4f2c-a277-d938f23da229', 'volume_name': 'volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1042e0-9520-4a70-b3b4-83b35fcf4b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1042e0-9520-4a70-b3b4-83b35fcf4b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e678a29-0cab-4544-bc9d-31f40368c4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:10 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Volume 89f3fe2a-b0f6-4f2c-a277-d938f23da229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229', 'volume_size': 1}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1316551917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f3fe2a-b0f6-4f2c-a277-d938f23da229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:10Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Creating volume 89f3fe2a-b0f6-4f2c-a277-d938f23da229 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:41:10 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:41:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:10 devstack sudo[101603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229 1073741824
Jul 06 15:41:10 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:11 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225" returned: 0 in 0.724s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Lock "cinder-quobyte-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225" released by "delete_volume" :: held 1.626s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Created reservations ['c89f9e7d-4874-45e5-b8a1-4ac9cf531d7c', 'a0c94514-dcbb-4d61-8ce8-dfb680a80462', '93a811fc-ce74-43f6-9df8-1271d1e1ca2c', '2b958526-9801-46ff-a873-1ed610fcdc2b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:11 devstack sudo[101610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:41:11 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:11 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229 1073741824" returned: 0 in 0.922s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:11 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229
Jul 06 15:41:11 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:11 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.763s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:41:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Deleted volume successfully.
Jul 06 15:41:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-18fa469a-2085-4575-b784-1dd671a96e8a tempest-TestMinimumBasicScenario-2138757572 None] Lock "cinder-438ee51b-6e6f-4c03-9dcc-c3d1ad7cc225-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:12 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229" returned: 0 in 0.690s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e678a29-0cab-4544-bc9d-31f40368c4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e4ce9c-71f7-4563-8f2c-a92631d4ea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:12 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Volume volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229 (89f3fe2a-b0f6-4f2c-a277-d938f23da229): created successfully
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e4ce9c-71f7-4563-8f2c-a92631d4ea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (0cce807f-a694-44fb-8cab-feabdf26d811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c8711855-a84d-45fd-a42b-39fd9451f57f tempest-VolumesActionsTest-608482758 None] Created volume successfully.
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Acquiring lock "cinder-89f3fe2a-b0f6-4f2c-a277-d938f23da229-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Lock "cinder-89f3fe2a-b0f6-4f2c-a277-d938f23da229-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Acquiring lock "cinder-quobyte-89f3fe2a-b0f6-4f2c-a277-d938f23da229" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Lock "cinder-quobyte-89f3fe2a-b0f6-4f2c-a277-d938f23da229" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d587a59-5e2e-4e81-a4d7-69a923b3b7c6]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:12 devstack sudo[101616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229
Jul 06 15:41:12 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:13 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229" returned: 0 in 0.886s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:13 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229
Jul 06 15:41:13 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:14 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-89f3fe2a-b0f6-4f2c-a277-d938f23da229" returned: 0 in 0.816s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:14 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Lock "cinder-quobyte-89f3fe2a-b0f6-4f2c-a277-d938f23da229" released by "delete_volume" :: held 1.750s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:14 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Created reservations ['7a295f21-e9a6-4a9b-8ddb-9f77e6ba3ade', 'dc1fb306-152f-46db-a4d8-a6ac9ef7f0a2', '446239da-e85e-4836-b0a6-1bb2dadf123b', '0b905174-7c06-4abd-992b-06348e49555c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:41:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:14 devstack sudo[101684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:41:14 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:15 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.740s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:41:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Deleted volume successfully.
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a43c6ecd-28df-476b-9c60-763f1addfed9 tempest-VolumesActionsTest-2017336561 None] Lock "cinder-89f3fe2a-b0f6-4f2c-a277-d938f23da229-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (5508958b-b770-474a-9565-b8d0143747a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4f7a89-e7a4-4553-8dd9-4bdb1f3087ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4f7a89-e7a4-4553-8dd9-4bdb1f3087ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409790315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ca3cb2-6f92-4896-b0c6-604a6cd3a65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:15Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5879626b-1123-42e3-b6ef-d00d2b29e24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5879626b-1123-42e3-b6ef-d00d2b29e24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af143d19-e79f-4bbf-a20b-1e283efcef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af143d19-e79f-4bbf-a20b-1e283efcef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ca3cb2-6f92-4896-b0c6-604a6cd3a65e', 'volume_name': 'volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c5949a-b498-40e6-8e5a-fd8fed112d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c5949a-b498-40e6-8e5a-fd8fed112d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bb989a-26dc-4515-ade7-d34ba70940a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:15 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Volume 46ca3cb2-6f92-4896-b0c6-604a6cd3a65e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e', 'volume_size': 1}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409790315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ca3cb2-6f92-4896-b0c6-604a6cd3a65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:15Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Creating volume 46ca3cb2-6f92-4896-b0c6-604a6cd3a65e {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:41:15 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:41:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:15 devstack sudo[101688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e 1073741824
Jul 06 15:41:15 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:16 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e 1073741824" returned: 0 in 0.867s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:16 devstack sudo[101694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e
Jul 06 15:41:16 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:17 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e" returned: 0 in 0.650s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bb989a-26dc-4515-ade7-d34ba70940a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014aee43-8529-4e37-977f-bcf8db7bee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:17 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Volume volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e (46ca3cb2-6f92-4896-b0c6-604a6cd3a65e): created successfully
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014aee43-8529-4e37-977f-bcf8db7bee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (5508958b-b770-474a-9565-b8d0143747a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:17 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6201be54-fc72-4cf7-89da-64e7011ce929 tempest-VolumesActionsTest-608482758 None] Created volume successfully.
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Acquiring lock "cinder-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Lock "cinder-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Acquiring lock "cinder-quobyte-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Lock "cinder-quobyte-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[477922d5-6fbb-4bfa-8c3a-532d642b6e57]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:17 devstack sudo[101697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e
Jul 06 15:41:17 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:18 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e" returned: 0 in 0.801s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:18 devstack sudo[101702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e
Jul 06 15:41:18 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:19 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e" returned: 0 in 0.720s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Lock "cinder-quobyte-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e" released by "delete_volume" :: held 1.569s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:19 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Created reservations ['22400cf2-65ab-4efb-b9a3-56b9cd06a4ae', '21d20cb3-7430-4c9f-9db0-484693d689b9', 'cfcd5799-f41a-4f10-b497-45e3b1d3d4d0', 'a223ced9-d993-45cf-88d6-4193242db74f'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:41:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:19 devstack sudo[101705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:41:19 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:20 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.654s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:41:20 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Deleted volume successfully.
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-75498878-3bfc-472e-95b6-3b4f55d0182d tempest-VolumesActionsTest-2017336561 None] Lock "cinder-46ca3cb2-6f92-4896-b0c6-604a6cd3a65e-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (7bb0e73d-9bcc-477f-842b-98007f894454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b419ff34-98c1-430e-b70c-16cbc7dc4cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b419ff34-98c1-430e-b70c-16cbc7dc4cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2011409794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd70620-f323-47e0-8be1-8645a2e2e518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:20Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf6e3f4-254b-421d-991e-0b65247beb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf6e3f4-254b-421d-991e-0b65247beb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2025fc0f-4834-43b6-829d-31b7debe2ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2025fc0f-4834-43b6-829d-31b7debe2ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd70620-f323-47e0-8be1-8645a2e2e518', 'volume_name': 'volume-edd70620-f323-47e0-8be1-8645a2e2e518', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f78eb27-4977-49b5-9580-7bcdfec2072b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f78eb27-4977-49b5-9580-7bcdfec2072b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591e9232-dac0-4b69-b35e-08e25da93442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:20 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Volume edd70620-f323-47e0-8be1-8645a2e2e518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd70620-f323-47e0-8be1-8645a2e2e518', 'volume_size': 1}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2011409794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd70620-f323-47e0-8be1-8645a2e2e518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368c3f72439444c7b1b1672121616861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:20Z,use_quota=True,user_id='efdcd1e951584153a91120c39597642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Creating volume edd70620-f323-47e0-8be1-8645a2e2e518 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:41:20 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:41:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:20 devstack sudo[101709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518 1073741824
Jul 06 15:41:20 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:21 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518 1073741824" returned: 0 in 0.936s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:21 devstack sudo[101715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518
Jul 06 15:41:21 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:22 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518" returned: 0 in 0.723s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:41:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591e9232-dac0-4b69-b35e-08e25da93442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd70620-f323-47e0-8be1-8645a2e2e518', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302e8509-2f83-4698-9c31-74fe375de670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:22 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Volume volume-edd70620-f323-47e0-8be1-8645a2e2e518 (edd70620-f323-47e0-8be1-8645a2e2e518): created successfully
Jul 06 15:41:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302e8509-2f83-4698-9c31-74fe375de670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Flow 'volume_create_manager' (7bb0e73d-9bcc-477f-842b-98007f894454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-49a7c131-7ab9-4d96-971f-cdb07b257b3f tempest-VolumesActionsTest-608482758 None] Created volume successfully.
Jul 06 15:41:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Acquiring lock "cinder-edd70620-f323-47e0-8be1-8645a2e2e518-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Lock "cinder-edd70620-f323-47e0-8be1-8645a2e2e518-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Acquiring lock "cinder-quobyte-edd70620-f323-47e0-8be1-8645a2e2e518" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Lock "cinder-quobyte-edd70620-f323-47e0-8be1-8645a2e2e518" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f6137e-bf76-498a-b81f-b0453f82f261]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:23 devstack sudo[101719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518
Jul 06 15:41:23 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:24 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518" returned: 0 in 0.794s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:24 devstack sudo[101730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518
Jul 06 15:41:24 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:24 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd70620-f323-47e0-8be1-8645a2e2e518" returned: 0 in 0.655s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Lock "cinder-quobyte-edd70620-f323-47e0-8be1-8645a2e2e518" released by "delete_volume" :: held 1.492s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Created reservations ['2af4203d-7cc9-4433-9d11-fe01edf6d5c8', '1998552f-964c-4ed9-ad7f-69b58fe7c752', '1137806b-9133-4b21-a70f-78d9ddb7357c', '8bb5d0f0-aaae-45c1-b046-f858c5490abb'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:24 devstack sudo[101734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:41:24 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:25 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.655s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:25 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:41:25 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Deleted volume successfully.
Jul 06 15:41:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5a1ea7a8-bd17-481c-96f3-c34127673e80 tempest-VolumesActionsTest-608482758 None] Lock "cinder-edd70620-f323-47e0-8be1-8645a2e2e518-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=55,cinder:UPDATE=84,cinder:INSERT=17,cinder:DELETE=7 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Flow 'volume_create_manager' (ae90e574-bc6a-40ad-9831-9894a3282fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5caab297-55dd-4cb0-baa7-720a0355b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5caab297-55dd-4cb0-baa7-720a0355b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1820268960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3e1cb4-6063-49f8-a62e-0aca68ea5462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2659a5d2c144d5aea52d66244c8bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:43Z,use_quota=True,user_id='9a3f918b9435419caee81c4eeb47058b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab13523-c060-478d-a706-08beae159d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab13523-c060-478d-a706-08beae159d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10135e9b-0613-4547-9d1a-62e7cd147235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.image.glance [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Creating Keystone auth plugin from conf {{(pid=86249) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10135e9b-0613-4547-9d1a-62e7cd147235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad3e1cb4-6063-49f8-a62e-0aca68ea5462', 'volume_name': 'volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8e9bd10>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a84d6df-3f28-4c6e-a4c3-4fad826de11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a84d6df-3f28-4c6e-a4c3-4fad826de11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0187dc20-c7d8-4a86-bdca-7f6a5e84adcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:43 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Volume ad3e1cb4-6063-49f8-a62e-0aca68ea5462: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8e9bd10>}
Jul 06 15:41:43 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Trying to clone ad3e1cb4-6063-49f8-a62e-0aca68ea5462 from image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]). {{(pid=86249) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 15:41:43 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 15:41:43 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 15:41:43 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50cb22d-00c1-4788-b076-114012ccfdac]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:43 devstack sudo[101747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD
Jul 06 15:41:43 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:44 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:44 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Temporary image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 is fetched for user 9a3f918b9435419caee81c4eeb47058b. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 15:41:44 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4d3b78-cdde-49cc-b419-3ac9e1a22684]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:44 devstack sudo[101752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD
Jul 06 15:41:44 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:45 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1820268960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3e1cb4-6063-49f8-a62e-0aca68ea5462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2659a5d2c144d5aea52d66244c8bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:43Z,use_quota=True,user_id='9a3f918b9435419caee81c4eeb47058b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Creating volume ad3e1cb4-6063-49f8-a62e-0aca68ea5462 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:41:45 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:45 devstack sudo[101757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 1073741824
Jul 06 15:41:45 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:45 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 1073741824" returned: 0 in 0.847s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=61,cinder:UPDATE=73,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:41:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:45 devstack sudo[101763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462
Jul 06 15:41:45 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:46 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462" returned: 0 in 0.781s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:41:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:46 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Attempting download of af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 ((None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}])) to volume ad3e1cb4-6063-49f8-a62e-0aca68ea5462. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 15:41:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a74ea6-7805-4d31-a197-e16d77e93380]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qfx6x5_p {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:46 devstack sudo[101766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qfx6x5_p
Jul 06 15:41:46 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:47 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qfx6x5_p" returned: 0 in 0.783s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qfx6x5_p {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:47 devstack sudo[101770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qfx6x5_p
Jul 06 15:41:47 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:48 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qfx6x5_p" returned: 1 in 0.814s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_qfx6x5_p' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:41:48 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e6b877-d1dd-450f-93e7-1f49352f0692]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:48 devstack sudo[101774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD
Jul 06 15:41:48 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:49 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD" returned: 0 in 0.839s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:49 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 was qcow2, converting to raw {{(pid=86249) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 15:41:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:49 devstack sudo[101779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462
Jul 06 15:41:49 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:51 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462" returned: 0 in 2.004s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_j9n15_1fdevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:41:51 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Converted 112.00 MB image at 55.85 MB/s
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:51 devstack sudo[101791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 1G
Jul 06 15:41:51 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Flow 'volume_create_manager' (07d2cf22-3a25-4dc5-b499-076cc8285f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d3fd73-8ab8-48db-9a14-edd5754c60d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d3fd73-8ab8-48db-9a14-edd5754c60d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1083514449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93ec24d-7c42-48c0-9588-cd408d03331e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2c4d4dcee84955b5fa53e0ca09ac48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:51Z,use_quota=True,user_id='c2017099cd5242b8b0903dee513da7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade336d3-ff66-4906-8730-c151cbad4c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade336d3-ff66-4906-8730-c151cbad4c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee831e5-74bc-4890-830f-8b4c3143d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee831e5-74bc-4890-830f-8b4c3143d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93ec24d-7c42-48c0-9588-cd408d03331e', 'volume_name': 'volume-b93ec24d-7c42-48c0-9588-cd408d03331e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb2e24a-1769-4fcb-9fb3-d73e10cd0b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb2e24a-1769-4fcb-9fb3-d73e10cd0b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6093ba-3bfc-4483-a16c-9c743f7b7b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:51 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Volume b93ec24d-7c42-48c0-9588-cd408d03331e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93ec24d-7c42-48c0-9588-cd408d03331e', 'volume_size': 1}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1083514449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93ec24d-7c42-48c0-9588-cd408d03331e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2c4d4dcee84955b5fa53e0ca09ac48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:51Z,use_quota=True,user_id='c2017099cd5242b8b0903dee513da7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Creating volume b93ec24d-7c42-48c0-9588-cd408d03331e {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:41:51 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:51 devstack sudo[101793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e 1073741824
Jul 06 15:41:51 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Flow 'volume_create_manager' (2d00e9cc-a95c-4ba2-86da-f53289eefaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172a5b49-5b3d-44a4-b58e-31fd07775c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172a5b49-5b3d-44a4-b58e-31fd07775c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-176025030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94a41f0-af5c-4a79-a942-7a02fb8865dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2c4d4dcee84955b5fa53e0ca09ac48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:52Z,use_quota=True,user_id='c2017099cd5242b8b0903dee513da7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ffedef-8845-4896-8c6b-0208274919e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ffedef-8845-4896-8c6b-0208274919e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5dadabd-63d8-49fc-baad-4d7647a7bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5dadabd-63d8-49fc-baad-4d7647a7bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94a41f0-af5c-4a79-a942-7a02fb8865dd', 'volume_name': 'volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c35576-d366-42ff-9a3f-335f02390f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c35576-d366-42ff-9a3f-335f02390f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c714447-5a6e-44dc-ab29-4aed6cd2f82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Volume d94a41f0-af5c-4a79-a942-7a02fb8865dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd', 'volume_size': 1}
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:52 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 1G" returned: 0 in 0.781s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acab030-82b0-4e5d-8c4b-d7176747ff21]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:52 devstack sudo[101798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462
Jul 06 15:41:52 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:52 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e 1073741824" returned: 0 in 0.943s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:52 devstack sudo[101805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e
Jul 06 15:41:52 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:52 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462" returned: 0 in 0.886s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:53 devstack sudo[101809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462
Jul 06 15:41:53 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:53 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e" returned: 0 in 0.705s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.307s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-176025030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94a41f0-af5c-4a79-a942-7a02fb8865dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2c4d4dcee84955b5fa53e0ca09ac48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:52Z,use_quota=True,user_id='c2017099cd5242b8b0903dee513da7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Creating volume d94a41f0-af5c-4a79-a942-7a02fb8865dd {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:41:53 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6093ba-3bfc-4483-a16c-9c743f7b7b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93ec24d-7c42-48c0-9588-cd408d03331e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:53 devstack sudo[101813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd 1073741824
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ca20de-d7e6-4546-b9d5-62eef4b0a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:53 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:53 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Volume volume-b93ec24d-7c42-48c0-9588-cd408d03331e (b93ec24d-7c42-48c0-9588-cd408d03331e): created successfully
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ca20de-d7e6-4546-b9d5-62eef4b0a582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Flow 'volume_create_manager' (07d2cf22-3a25-4dc5-b499-076cc8285f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:53 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d6c13adf-3a00-4313-8d9d-8e7fd9c8688c tempest-TestServerVolumeAttachmentScenario-860004733 None] Created volume successfully.
Jul 06 15:41:53 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462" returned: 1 in 0.825s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Downloaded image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 ((None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}])) to volume ad3e1cb4-6063-49f8-a62e-0aca68ea5462 successfully. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Temporary image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 for user 9a3f918b9435419caee81c4eeb47058b is deleted. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Marking volume ad3e1cb4-6063-49f8-a62e-0aca68ea5462 as bootable. {{(pid=86249) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Copying metadata from image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 to ad3e1cb4-6063-49f8-a62e-0aca68ea5462. {{(pid=86249) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Creating volume glance metadata for volume ad3e1cb4-6063-49f8-a62e-0aca68ea5462 backed by image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86249) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0187dc20-c7d8-4a86-bdca-7f6a5e84adcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c8e9bd10>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7331035f-8e87-4479-9a97-a58fbd1898b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:53 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Volume volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 (ad3e1cb4-6063-49f8-a62e-0aca68ea5462): created successfully
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7331035f-8e87-4479-9a97-a58fbd1898b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Flow 'volume_create_manager' (ae90e574-bc6a-40ad-9831-9894a3282fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:53 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-72cb12f0-46ae-4266-ba08-a819d864c7dc tempest-VolumesImageMetadata-462651159 None] Created volume successfully.
Jul 06 15:41:54 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd 1073741824" returned: 0 in 0.928s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:54 devstack sudo[101822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd
Jul 06 15:41:54 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Acquiring lock "cinder-ad3e1cb4-6063-49f8-a62e-0aca68ea5462-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Lock "cinder-ad3e1cb4-6063-49f8-a62e-0aca68ea5462-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Acquiring lock "cinder-quobyte-ad3e1cb4-6063-49f8-a62e-0aca68ea5462" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:41:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Lock "cinder-quobyte-ad3e1cb4-6063-49f8-a62e-0aca68ea5462" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:41:54 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3760c6d-f56d-47c2-853e-b928012cea53]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:41:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:54 devstack sudo[101824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462
Jul 06 15:41:54 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:55 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd" returned: 0 in 0.726s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:55 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:41:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c714447-5a6e-44dc-ab29-4aed6cd2f82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c07b34-e4d2-4319-99cd-6b9315ea0514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:41:55 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Volume volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd (d94a41f0-af5c-4a79-a942-7a02fb8865dd): created successfully
Jul 06 15:41:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c07b34-e4d2-4319-99cd-6b9315ea0514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:41:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Flow 'volume_create_manager' (2d00e9cc-a95c-4ba2-86da-f53289eefaed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:41:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bde1b0eb-2aab-4763-9555-4e1a9273b815 tempest-TestServerVolumeAttachmentScenario-860004733 None] Created volume successfully.
Jul 06 15:41:55 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462" returned: 0 in 0.786s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:55 devstack sudo[101832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462
Jul 06 15:41:55 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:56 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462" returned: 1 in 0.732s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:41:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:56 devstack sudo[101837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462
Jul 06 15:41:56 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:57 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ad3e1cb4-6063-49f8-a62e-0aca68ea5462" returned: 0 in 0.655s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Lock "cinder-quobyte-ad3e1cb4-6063-49f8-a62e-0aca68ea5462" released by "delete_volume" :: held 2.234s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Created reservations ['a3f0ddb2-2460-46ec-a95a-f8b03e7e5ba7', '7229ccf1-2ada-44b5-88c5-333215f57830', 'a4085efa-a6c1-4738-acf2-d917ac76661f', 'ec4d7d3e-9aa5-408a-9f41-1fb5e6964b75'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:41:57 devstack sudo[101840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:41:57 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:41:57 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.618s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:41:57 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Deleted volume successfully.
Jul 06 15:41:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e781ba77-f325-4288-ad91-17e84f7fe720 tempest-VolumesImageMetadata-462651159 None] Lock "cinder-ad3e1cb4-6063-49f8-a62e-0aca68ea5462-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:42:00 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:42:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Flow 'volume_create_manager' (e6ecd673-d28f-424b-8b65-f16a6cbd3aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:42:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9d38b3-308c-4932-99bd-475327931ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9d38b3-308c-4932-99bd-475327931ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1945380175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd8eeb0-8fb9-41ad-b215-cdd50317d480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765fea2c04664a1e9f7a188154a56312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:01Z,use_quota=True,user_id='43c6748f6c1844e2bad57a0fa2ab2f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f98f21-d223-40c1-9100-f27cf25223c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f98f21-d223-40c1-9100-f27cf25223c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecc2ecc-2aca-4863-a695-9b972ed44005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecc2ecc-2aca-4863-a695-9b972ed44005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd8eeb0-8fb9-41ad-b215-cdd50317d480', 'volume_name': 'volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdb81d7-e08f-4b20-8da2-3136eef0b465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdb81d7-e08f-4b20-8da2-3136eef0b465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76851fe0-4881-4980-bb49-08593e3cedb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:01 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Volume edd8eeb0-8fb9-41ad-b215-cdd50317d480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480', 'volume_size': 1}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1945380175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd8eeb0-8fb9-41ad-b215-cdd50317d480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765fea2c04664a1e9f7a188154a56312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:01Z,use_quota=True,user_id='43c6748f6c1844e2bad57a0fa2ab2f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Creating volume edd8eeb0-8fb9-41ad-b215-cdd50317d480 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:42:01 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:01 devstack sudo[101845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 1073741824
Jul 06 15:42:01 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:01 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 1073741824" returned: 0 in 0.841s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:01 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480
Jul 06 15:42:01 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:02 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480" returned: 0 in 0.636s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:42:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76851fe0-4881-4980-bb49-08593e3cedb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc354216-b845-4d6b-a4b4-211df514a60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:02 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Volume volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 (edd8eeb0-8fb9-41ad-b215-cdd50317d480): created successfully
Jul 06 15:42:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc354216-b845-4d6b-a4b4-211df514a60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Flow 'volume_create_manager' (e6ecd673-d28f-424b-8b65-f16a6cbd3aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:42:02 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-eaf62a13-318b-46b8-bf3b-0d701c06ec56 tempest-SnapshotMetadataTestJSON-983567614 None] Created volume successfully.
Jul 06 15:42:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Creating offline snapshot fd52d1d6-1110-4716-b8cc-8e11c2781a0e of volume edd8eeb0-8fb9-41ad-b215-cdd50317d480 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:42:03 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e10d5f-d659-44be-ad0d-9459eac2e8c0]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:42:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:03 devstack sudo[101871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480
Jul 06 15:42:03 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:03 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480" returned: 0 in 0.750s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:03 devstack sudo[101876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e 1G
Jul 06 15:42:03 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:04 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e 1G" returned: 0 in 0.773s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:04 devstack sudo[101885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e
Jul 06 15:42:04 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:05 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e" returned: 0 in 0.891s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:05 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e is being set with open permissions: ugo+rw
Jul 06 15:42:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:05 devstack sudo[101934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e
Jul 06 15:42:05 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:06 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e" returned: 0 in 0.677s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:06 devstack sudo[101937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.info
Jul 06 15:42:06 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:42:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:42:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:42:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:06 devstack sudo[101959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:42:06 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:07 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.info" returned: 0 in 0.701s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:07 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.info is being set with open permissions: ugo+rw
Jul 06 15:42:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:07 devstack sudo[101963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.info
Jul 06 15:42:07 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:07 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.685s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:42:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:42:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:42:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:42:07 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.info" returned: 0 in 0.692s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.578s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:07 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1de1adb6-1675-4603-85aa-fc4ae6edcf37 tempest-SnapshotMetadataTestJSON-983567614 None] Create snapshot completed successfully
Jul 06 15:42:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Acquiring lock "cinder-fd52d1d6-1110-4716-b8cc-8e11c2781a0e-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:42:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "cinder-fd52d1d6-1110-4716-b8cc-8e11c2781a0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:42:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Acquiring lock "cinder-quobyte-edd8eeb0-8fb9-41ad-b215-cdd50317d480" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:42:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "cinder-quobyte-edd8eeb0-8fb9-41ad-b215-cdd50317d480" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:42:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Acquiring lock "cinder-quobyte-fd52d1d6-1110-4716-b8cc-8e11c2781a0e" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:42:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "cinder-quobyte-fd52d1d6-1110-4716-b8cc-8e11c2781a0e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:42:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Deleting offline snapshot fd52d1d6-1110-4716-b8cc-8e11c2781a0e of volume edd8eeb0-8fb9-41ad-b215-cdd50317d480 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:42:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] snapshot_file for this snap is: volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:42:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a87a8-0ef5-4c71-b9ed-186a1354a5e6]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:42:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:09 devstack sudo[101969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e
Jul 06 15:42:09 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:10 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e" returned: 0 in 0.869s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:42:10 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43741b-f453-4c1c-bf46-cb0a9c2112d6]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:42:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:10 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480
Jul 06 15:42:10 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:11 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480" returned: 0 in 0.896s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:11 devstack sudo[101984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e
Jul 06 15:42:11 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:11 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e" returned: 0 in 0.889s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:12 devstack sudo[101989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e
Jul 06 15:42:12 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:12 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480.fd52d1d6-1110-4716-b8cc-8e11c2781a0e" returned: 0 in 0.717s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "cinder-quobyte-fd52d1d6-1110-4716-b8cc-8e11c2781a0e" released by "_delete_snapshot" :: held 3.502s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:42:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "cinder-quobyte-edd8eeb0-8fb9-41ad-b215-cdd50317d480" released by "delete_snapshot" :: held 3.529s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:42:12 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Created reservations ['89c8ce31-b227-4317-bf13-c6c7ad87fbd1', '6d666f81-df33-4987-a1ea-38bdebbf8cc7', '4094d014-75de-4099-b12e-8bfda2de44dc', '8bf3d0c8-651d-45d6-b718-58293be4aa68'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:42:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Delete snapshot completed successfully.
Jul 06 15:42:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-590d50fd-9798-4013-869c-a05f3e863bc5 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "cinder-fd52d1d6-1110-4716-b8cc-8e11c2781a0e-delete_snapshot" released by "delete_snapshot" :: held 3.670s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:42:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Acquiring lock "cinder-edd8eeb0-8fb9-41ad-b215-cdd50317d480-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:42:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "cinder-edd8eeb0-8fb9-41ad-b215-cdd50317d480-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:42:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Acquiring lock "cinder-quobyte-edd8eeb0-8fb9-41ad-b215-cdd50317d480" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:42:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "cinder-quobyte-edd8eeb0-8fb9-41ad-b215-cdd50317d480" acquired by "delete_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:42:13 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7408b5-d719-4193-b820-c6479a7242c2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:42:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:13 devstack sudo[102028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480
Jul 06 15:42:13 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:14 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480" returned: 0 in 0.775s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:14 devstack sudo[102033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480
Jul 06 15:42:14 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:15 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-edd8eeb0-8fb9-41ad-b215-cdd50317d480" returned: 0 in 0.613s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "cinder-quobyte-edd8eeb0-8fb9-41ad-b215-cdd50317d480" released by "delete_volume" :: held 1.450s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Created reservations ['2d834be7-e29d-4d10-9073-cb6c58d8bbf1', '36705fb8-30cc-4440-a754-3c714eb99c05', '45717395-7593-433b-869d-87dbf1736c37', 'e5d77177-8a15-43fc-99da-62bc9c8f9826'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:15 devstack sudo[102036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:42:15 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:15 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.642s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:42:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Deleted volume successfully.
Jul 06 15:42:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cd5e38c-08b0-44e7-aa09-618d523835e9 tempest-SnapshotMetadataTestJSON-983567614 None] Lock "cinder-edd8eeb0-8fb9-41ad-b215-cdd50317d480-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Flow 'volume_create_manager' (c2c1ea82-247b-4fca-ba2f-37a1ac967ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43758d1-7e96-48e4-accc-e84a4257edcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43758d1-7e96-48e4-accc-e84a4257edcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1344888685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e9c257-41c5-451c-be9d-35791a0381f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13395118554c4cb99fdde5ffe8fb0445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:20Z,use_quota=True,user_id='f6f9a1c3ed7041729423f4f30344dc6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999ebe86-3d88-4e41-b9b1-ced3b3d91668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999ebe86-3d88-4e41-b9b1-ced3b3d91668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f51ca5-1976-4a37-971c-4c582a96ab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f51ca5-1976-4a37-971c-4c582a96ab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e9c257-41c5-451c-be9d-35791a0381f7', 'volume_name': 'volume-91e9c257-41c5-451c-be9d-35791a0381f7', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85210235-4d38-4d53-aabf-c98cb1cc1229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85210235-4d38-4d53-aabf-c98cb1cc1229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b897885-2645-459f-90b2-bbf62f2ec9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:20 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Volume 91e9c257-41c5-451c-be9d-35791a0381f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e9c257-41c5-451c-be9d-35791a0381f7', 'volume_size': 1}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1344888685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e9c257-41c5-451c-be9d-35791a0381f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13395118554c4cb99fdde5ffe8fb0445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:20Z,use_quota=True,user_id='f6f9a1c3ed7041729423f4f30344dc6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Creating volume 91e9c257-41c5-451c-be9d-35791a0381f7 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:42:20 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:42:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:20 devstack sudo[102060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7 1073741824
Jul 06 15:42:20 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:21 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7 1073741824" returned: 0 in 0.763s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:21 devstack sudo[102066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7
Jul 06 15:42:21 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:21 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7" returned: 0 in 0.627s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:42:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b897885-2645-459f-90b2-bbf62f2ec9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e9c257-41c5-451c-be9d-35791a0381f7', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f067580c-8dcc-4401-9e37-bbc128c3676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:21 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Volume volume-91e9c257-41c5-451c-be9d-35791a0381f7 (91e9c257-41c5-451c-be9d-35791a0381f7): created successfully
Jul 06 15:42:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f067580c-8dcc-4401-9e37-bbc128c3676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Flow 'volume_create_manager' (c2c1ea82-247b-4fca-ba2f-37a1ac967ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:42:21 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ee391355-b916-4c4b-93b4-25953663c1d0 tempest-VolumesTransfersV355Test-2083562227 None] Created volume successfully.
Jul 06 15:42:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6a7674f9-cb2b-47b1-a51b-06add99308b6 tempest-VolumesTransfersV355Test-528748866 None] Transfer volume completed successfully.
Jul 06 15:42:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Acquiring lock "cinder-91e9c257-41c5-451c-be9d-35791a0381f7-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:42:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Lock "cinder-91e9c257-41c5-451c-be9d-35791a0381f7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:42:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Acquiring lock "cinder-quobyte-91e9c257-41c5-451c-be9d-35791a0381f7" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:42:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Lock "cinder-quobyte-91e9c257-41c5-451c-be9d-35791a0381f7" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:42:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adb643e-853e-4bca-93ed-5f07b1d81191]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:42:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:23 devstack sudo[102075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7
Jul 06 15:42:23 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:24 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7" returned: 0 in 0.755s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:24 devstack sudo[102080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7
Jul 06 15:42:24 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:25 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-91e9c257-41c5-451c-be9d-35791a0381f7" returned: 0 in 0.616s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Lock "cinder-quobyte-91e9c257-41c5-451c-be9d-35791a0381f7" released by "delete_volume" :: held 1.419s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Created reservations ['4766f727-246a-49ee-ada2-245ddfe8ee72', 'a7bb1f98-8639-48dd-b49b-f45655afb1b3', '35661415-479e-4760-8daf-41a1a35e56cb', 'bd5d67d8-8f45-4d1a-a362-fc1db7c3df44'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:25 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:42:25 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:25 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.638s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:42:25 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Deleted volume successfully.
Jul 06 15:42:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-994eb1a9-2be4-4f19-b45c-89ebc9128382 tempest-VolumesTransfersV355Test-1737545383 None] Lock "cinder-91e9c257-41c5-451c-be9d-35791a0381f7-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Flow 'volume_create_manager' (36394d25-b2b0-4b8c-8ee4-bcd23e65acf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118499a4-07b2-494b-880a-25d72a04b499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118499a4-07b2-494b-880a-25d72a04b499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1353010689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983000c0-41a5-4ddd-8a23-3c9706961012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13395118554c4cb99fdde5ffe8fb0445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:26Z,use_quota=True,user_id='f6f9a1c3ed7041729423f4f30344dc6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d858cfa0-35c9-40ca-88dd-e9772eb6bf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d858cfa0-35c9-40ca-88dd-e9772eb6bf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9d0c56-9c26-4a6e-9b18-75021e17937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9d0c56-9c26-4a6e-9b18-75021e17937b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983000c0-41a5-4ddd-8a23-3c9706961012', 'volume_name': 'volume-983000c0-41a5-4ddd-8a23-3c9706961012', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a3609a-aaa4-46eb-98be-732dad14095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a3609a-aaa4-46eb-98be-732dad14095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b15d26f-46f1-40d9-9c7f-d2549645b4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:26 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Volume 983000c0-41a5-4ddd-8a23-3c9706961012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983000c0-41a5-4ddd-8a23-3c9706961012', 'volume_size': 1}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1353010689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983000c0-41a5-4ddd-8a23-3c9706961012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13395118554c4cb99fdde5ffe8fb0445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:26Z,use_quota=True,user_id='f6f9a1c3ed7041729423f4f30344dc6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Creating volume 983000c0-41a5-4ddd-8a23-3c9706961012 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:42:26 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:42:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:26 devstack sudo[102086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012 1073741824
Jul 06 15:42:26 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:27 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012 1073741824" returned: 0 in 0.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:27 devstack sudo[102092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012
Jul 06 15:42:27 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:27 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012" returned: 0 in 0.636s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:42:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b15d26f-46f1-40d9-9c7f-d2549645b4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983000c0-41a5-4ddd-8a23-3c9706961012', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29dafbc2-10eb-4644-9f80-f81a05148d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:27 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Volume volume-983000c0-41a5-4ddd-8a23-3c9706961012 (983000c0-41a5-4ddd-8a23-3c9706961012): created successfully
Jul 06 15:42:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29dafbc2-10eb-4644-9f80-f81a05148d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Flow 'volume_create_manager' (36394d25-b2b0-4b8c-8ee4-bcd23e65acf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:42:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-387cb56a-1137-4f18-bbc6-f72981922b33 tempest-VolumesTransfersV355Test-2083562227 None] Created volume successfully.
Jul 06 15:42:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Acquiring lock "cinder-983000c0-41a5-4ddd-8a23-3c9706961012-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:42:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Lock "cinder-983000c0-41a5-4ddd-8a23-3c9706961012-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:42:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Acquiring lock "cinder-quobyte-983000c0-41a5-4ddd-8a23-3c9706961012" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:42:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Lock "cinder-quobyte-983000c0-41a5-4ddd-8a23-3c9706961012" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:42:28 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d369527-a3d6-4b5d-93ee-5b18d15eb2ca]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:42:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:28 devstack sudo[102095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012
Jul 06 15:42:28 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:29 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012" returned: 0 in 0.753s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:29 devstack sudo[102100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012
Jul 06 15:42:29 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:30 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-983000c0-41a5-4ddd-8a23-3c9706961012" returned: 0 in 0.602s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Lock "cinder-quobyte-983000c0-41a5-4ddd-8a23-3c9706961012" released by "delete_volume" :: held 1.397s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:42:30 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Created reservations ['5bbb175f-8e82-414e-abb6-4c281d934199', '80bf302a-6bb6-45e4-832f-d944d42cce1f', '0e87f3a2-8706-4e1b-8cbb-3c1d6587daf6', 'a5ad4908-0d4a-4cef-87d1-3dfd1cea6dbc'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:42:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:42:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:42:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:30 devstack sudo[102104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:42:30 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:31 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.693s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:31 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:42:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Deleted volume successfully.
Jul 06 15:42:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-40cc4f4e-e686-4c96-bb57-165406355893 tempest-VolumesTransfersV355Test-1737545383 None] Lock "cinder-983000c0-41a5-4ddd-8a23-3c9706961012-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:42:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-74f0917e-f976-4e20-9a9a-a88f8bdad43b req-45abd0f7-d6f9-4273-958a-bc99fe6480b1 tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-74f0917e-f976-4e20-9a9a-a88f8bdad43b req-45abd0f7-d6f9-4273-958a-bc99fe6480b1 tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:34 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfa55f3-cc8d-47e2-8fd0-4bf766947627]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:42:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-74f0917e-f976-4e20-9a9a-a88f8bdad43b req-45abd0f7-d6f9-4273-958a-bc99fe6480b1 tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:34 devstack sudo[102120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e
Jul 06 15:42:34 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:35 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-74f0917e-f976-4e20-9a9a-a88f8bdad43b req-45abd0f7-d6f9-4273-958a-bc99fe6480b1 tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e" returned: 0 in 0.756s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-74f0917e-f976-4e20-9a9a-a88f8bdad43b req-45abd0f7-d6f9-4273-958a-bc99fe6480b1 tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.772s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-74f0917e-f976-4e20-9a9a-a88f8bdad43b req-45abd0f7-d6f9-4273-958a-bc99fe6480b1 tempest-TestServerVolumeAttachmentScenario-860004733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-b93ec24d-7c42-48c0-9588-cd408d03331e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3c00c88-8ac9-4bbe-b9fe-bd24151633c3', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:42:35 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-74f0917e-f976-4e20-9a9a-a88f8bdad43b req-45abd0f7-d6f9-4273-958a-bc99fe6480b1 tempest-TestServerVolumeAttachmentScenario-860004733 None] attachment_update completed successfully.
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=53,cinder:INSERT=23,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Flow 'volume_create_manager' (0aa037e3-1d47-4ab1-84c4-7b3fb38da3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdb8971-e4b5-44df-abb1-e5d144706a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdb8971-e4b5-44df-abb1-e5d144706a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-131276980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12e7ba7-9d07-48f9-bf82-30ebc17647b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5bf7e08c0949809b6b94a2cd04755c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:45Z,use_quota=True,user_id='291ce5a53ceb405e8d6e308c25affa59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e30b840-503d-4fee-951d-0e47b3a9763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e30b840-503d-4fee-951d-0e47b3a9763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d65480a-4b55-411d-82d0-aca479d0b60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d65480a-4b55-411d-82d0-aca479d0b60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12e7ba7-9d07-48f9-bf82-30ebc17647b5', 'volume_name': 'volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9fcd91-032b-4c8d-bb52-133fa17554b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9fcd91-032b-4c8d-bb52-133fa17554b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fa6206-1516-46f6-a648-6629b0735475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:45 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Volume f12e7ba7-9d07-48f9-bf82-30ebc17647b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5', 'volume_size': 1}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-131276980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12e7ba7-9d07-48f9-bf82-30ebc17647b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5bf7e08c0949809b6b94a2cd04755c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:45Z,use_quota=True,user_id='291ce5a53ceb405e8d6e308c25affa59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Creating volume f12e7ba7-9d07-48f9-bf82-30ebc17647b5 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:42:45 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:45 devstack sudo[102519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 1073741824
Jul 06 15:42:45 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-67073683-08b9-40f1-9e1c-94f95c6593ae req-a68453bf-4f1c-41dc-b913-50934c6b62aa tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:42:46 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 1073741824" returned: 0 in 0.824s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=55,cinder:UPDATE=54,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:46 devstack sudo[102533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5
Jul 06 15:42:46 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:46 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" returned: 0 in 0.612s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-67073683-08b9-40f1-9e1c-94f95c6593ae req-a68453bf-4f1c-41dc-b913-50934c6b62aa tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.119s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fa6206-1516-46f6-a648-6629b0735475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1467eef-ec12-43cd-8a85-d72633f142cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f62a0c9-c6ce-431b-b093-fbff3db70969]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-67073683-08b9-40f1-9e1c-94f95c6593ae req-a68453bf-4f1c-41dc-b913-50934c6b62aa tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:42:46 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Volume volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 (f12e7ba7-9d07-48f9-bf82-30ebc17647b5): created successfully
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1467eef-ec12-43cd-8a85-d72633f142cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:42:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Flow 'volume_create_manager' (0aa037e3-1d47-4ab1-84c4-7b3fb38da3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:42:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-243bc00c-c317-484d-88bf-4e343ddc7213 tempest-VolumesActionsTest-1900291888 None] Created volume successfully.
Jul 06 15:42:46 devstack sudo[102536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd
Jul 06 15:42:46 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:42:47 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root
Jul 06 15:42:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [req-67073683-08b9-40f1-9e1c-94f95c6593ae req-a68453bf-4f1c-41dc-b913-50934c6b62aa tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd" returned: 0 in 0.754s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:42:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [req-67073683-08b9-40f1-9e1c-94f95c6593ae req-a68453bf-4f1c-41dc-b913-50934c6b62aa tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.783s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:42:47 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-67073683-08b9-40f1-9e1c-94f95c6593ae req-a68453bf-4f1c-41dc-b913-50934c6b62aa tempest-TestServerVolumeAttachmentScenario-860004733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc', 'name': 'volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '793c7b12-ad9b-496d-ad49-bb1cc6a92c0d', 'enforce_multipath': True} {{(pid=86249) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 15:42:47 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-67073683-08b9-40f1-9e1c-94f95c6593ae req-a68453bf-4f1c-41dc-b913-50934c6b62aa tempest-TestServerVolumeAttachmentScenario-860004733 None] attachment_update completed successfully.
Jul 06 15:42:53 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-0f26c9df-4a18-406c-9250-8ee10c464452 req-62344102-089d-4f2a-9648-dad0314044ad tempest-TestServerVolumeAttachmentScenario-860004733 None] Terminate volume connection completed successfully.
Jul 06 15:42:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-0f26c9df-4a18-406c-9250-8ee10c464452 req-62344102-089d-4f2a-9648-dad0314044ad tempest-TestServerVolumeAttachmentScenario-860004733 None] Deleting attachment 793c7b12-ad9b-496d-ad49-bb1cc6a92c0d. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:42:57 devstack cinder-volume[86249]: INFO cinder.volume.manager [req-290707e0-dc59-4599-948a-45169b71cc5a req-0bf7e137-0f64-4336-8753-c3bacb6aea89 tempest-TestServerVolumeAttachmentScenario-860004733 None] Terminate volume connection completed successfully.
Jul 06 15:42:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [req-290707e0-dc59-4599-948a-45169b71cc5a req-0bf7e137-0f64-4336-8753-c3bacb6aea89 tempest-TestServerVolumeAttachmentScenario-860004733 None] Deleting attachment b3c00c88-8ac9-4bbe-b9fe-bd24151633c3. {{(pid=86249) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 15:43:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-73b3a05d-7616-48e6-a258-565fda9e10b2 tempest-VolumesActionsTest-1900291888 None] Acquiring lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" by "attach_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-73b3a05d-7616-48e6-a258-565fda9e10b2 tempest-VolumesActionsTest-1900291888 None] Lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" acquired by "attach_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:02 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-73b3a05d-7616-48e6-a258-565fda9e10b2 tempest-VolumesActionsTest-1900291888 None] Attaching volume f12e7ba7-9d07-48f9-bf82-30ebc17647b5 to instance 170c8dde-5079-4a53-9691-e9c63dbdf7cb at mountpoint /dev/vdb on host None.
Jul 06 15:43:02 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-73b3a05d-7616-48e6-a258-565fda9e10b2 tempest-VolumesActionsTest-1900291888 None] Attach volume completed successfully.
Jul 06 15:43:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-73b3a05d-7616-48e6-a258-565fda9e10b2 tempest-VolumesActionsTest-1900291888 None] Lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" released by "attach_volume" :: held 0.146s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5df7de5d-64d8-4a86-bb1b-53ce5cb56ba9 tempest-VolumesActionsTest-1900291888 None] Acquiring lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5-detach_volume" by "detach_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5df7de5d-64d8-4a86-bb1b-53ce5cb56ba9 tempest-VolumesActionsTest-1900291888 None] Lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:03 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5df7de5d-64d8-4a86-bb1b-53ce5cb56ba9 tempest-VolumesActionsTest-1900291888 None] Detaching volume f12e7ba7-9d07-48f9-bf82-30ebc17647b5 from instance 170c8dde-5079-4a53-9691-e9c63dbdf7cb.
Jul 06 15:43:03 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5df7de5d-64d8-4a86-bb1b-53ce5cb56ba9 tempest-VolumesActionsTest-1900291888 None] Detach volume completed successfully.
Jul 06 15:43:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5df7de5d-64d8-4a86-bb1b-53ce5cb56ba9 tempest-VolumesActionsTest-1900291888 None] Lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:43:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:06 devstack sudo[102706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:43:06 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:07 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.766s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "cinder-d94a41f0-af5c-4a79-a942-7a02fb8865dd-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "cinder-d94a41f0-af5c-4a79-a942-7a02fb8865dd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "cinder-quobyte-d94a41f0-af5c-4a79-a942-7a02fb8865dd" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "cinder-quobyte-d94a41f0-af5c-4a79-a942-7a02fb8865dd" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[14319496-9d93-416d-a947-2978168c46e3]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:07 devstack sudo[102711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd
Jul 06 15:43:07 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:08 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd" returned: 0 in 0.767s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:08 devstack sudo[102716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd
Jul 06 15:43:08 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:09 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d94a41f0-af5c-4a79-a942-7a02fb8865dd" returned: 0 in 0.634s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "cinder-quobyte-d94a41f0-af5c-4a79-a942-7a02fb8865dd" released by "delete_volume" :: held 1.472s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Created reservations ['9d89d6c4-1604-4841-8816-630ff510fccc', 'f6bacf13-5007-4b1e-9343-a61c69b372cd', '185ecd19-487f-4e3a-bbaa-109e194999a8', '66fb167f-6157-4c8f-bb05-23485f162196'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:09 devstack sudo[102719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:43:09 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "cinder-b93ec24d-7c42-48c0-9588-cd408d03331e-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "cinder-b93ec24d-7c42-48c0-9588-cd408d03331e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "cinder-quobyte-b93ec24d-7c42-48c0-9588-cd408d03331e" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "cinder-quobyte-b93ec24d-7c42-48c0-9588-cd408d03331e" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:09 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.666s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:43:09 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Deleted volume successfully.
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c3f576-98bb-4959-a239-7e9e7ee73b35]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ac5b9922-f686-4c13-acf2-65612051dd0f tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "cinder-d94a41f0-af5c-4a79-a942-7a02fb8865dd-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:10 devstack sudo[102724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e
Jul 06 15:43:10 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:10 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e" returned: 0 in 0.737s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:10 devstack sudo[102730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e
Jul 06 15:43:10 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:11 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-b93ec24d-7c42-48c0-9588-cd408d03331e" returned: 0 in 0.649s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "cinder-quobyte-b93ec24d-7c42-48c0-9588-cd408d03331e" released by "delete_volume" :: held 1.441s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:11 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Created reservations ['c1c82245-15ee-4ea8-a112-321ed276c7f7', '5b964ac6-560e-4bf4-9614-b3b64505d7c1', '63576b75-e78c-40d0-8b29-4c6130950fef', '86d8ae9e-aef3-4e77-943f-f6bd3afb96a3'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:43:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:11 devstack sudo[102736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:43:11 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:12 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.639s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:12 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:43:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Deleted volume successfully.
Jul 06 15:43:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e1a3a3d2-9c13-4e4e-913e-de13e78c9b7b tempest-TestServerVolumeAttachmentScenario-860004733 None] Lock "cinder-b93ec24d-7c42-48c0-9588-cd408d03331e-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:21 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=24,cinder:DELETE=2,cinder:SELECT=19,cinder:INSERT=4 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (23140c56-b61d-46a0-93fc-b6de12807f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028f2f5c-d9e5-4a5b-8700-69b02574f755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028f2f5c-d9e5-4a5b-8700-69b02574f755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2005465643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513caaae-c5e7-4e14-b93c-b9dec1a83a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:22Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f05bf5-de5e-40ca-b70f-a79e1bc98532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f05bf5-de5e-40ca-b70f-a79e1bc98532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14cc405-f96e-4533-adf6-8a92e97b305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14cc405-f96e-4533-adf6-8a92e97b305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513caaae-c5e7-4e14-b93c-b9dec1a83a0b', 'volume_name': 'volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d986f079-7d02-4767-b43a-47bdeff6dc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d986f079-7d02-4767-b43a-47bdeff6dc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf125194-0b72-4d64-afb4-4604045d1047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:22 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume 513caaae-c5e7-4e14-b93c-b9dec1a83a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b', 'volume_size': 1}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2005465643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513caaae-c5e7-4e14-b93c-b9dec1a83a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:22Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Creating volume 513caaae-c5e7-4e14-b93c-b9dec1a83a0b {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:43:22 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:43:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:22 devstack sudo[102843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b 1073741824
Jul 06 15:43:22 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:23 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b 1073741824" returned: 0 in 0.952s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:23 devstack sudo[102868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b
Jul 06 15:43:23 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:24 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b" returned: 0 in 0.715s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:43:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf125194-0b72-4d64-afb4-4604045d1047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27efc67e-c188-4afa-862a-2a19296beafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:24 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b (513caaae-c5e7-4e14-b93c-b9dec1a83a0b): created successfully
Jul 06 15:43:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27efc67e-c188-4afa-862a-2a19296beafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (23140c56-b61d-46a0-93fc-b6de12807f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:24 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-23d5ca34-2190-4a29-a67f-3e34fb6f33a3 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created volume successfully.
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (34b86419-97c6-41a8-b69f-84c7b8e88b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d12735-cd12-4736-9c92-f1a0cb5713a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d12735-cd12-4736-9c92-f1a0cb5713a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365287553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e781c7-56cc-41bc-a529-471eeb8cc55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:25Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0352ddb-8c9a-4bbf-ad18-da9f89b8a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0352ddb-8c9a-4bbf-ad18-da9f89b8a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e956c5-fa3c-403f-acd3-b4e8531a6fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e956c5-fa3c-403f-acd3-b4e8531a6fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e781c7-56cc-41bc-a529-471eeb8cc55d', 'volume_name': 'volume-26e781c7-56cc-41bc-a529-471eeb8cc55d', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae93463-6654-43ca-887e-29bd7f959648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae93463-6654-43ca-887e-29bd7f959648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807243d4-a28d-4665-aff2-2474947ea701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:25 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume 26e781c7-56cc-41bc-a529-471eeb8cc55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e781c7-56cc-41bc-a529-471eeb8cc55d', 'volume_size': 1}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365287553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e781c7-56cc-41bc-a529-471eeb8cc55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:25Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Creating volume 26e781c7-56cc-41bc-a529-471eeb8cc55d {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:43:25 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:25 devstack sudo[102879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d 1073741824
Jul 06 15:43:25 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (b544d593-6481-4742-84cc-81d791b89d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6fa887-f5d5-449c-bb1c-6ee134174f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6fa887-f5d5-449c-bb1c-6ee134174f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2071897318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5553896b-15a8-4e6a-89a7-a740c09b61be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:25Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638a74db-fd44-4d43-b1c3-1dab89eb3251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638a74db-fd44-4d43-b1c3-1dab89eb3251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6b558f-d46a-4efa-b7ed-348c00691d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6b558f-d46a-4efa-b7ed-348c00691d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5553896b-15a8-4e6a-89a7-a740c09b61be', 'volume_name': 'volume-5553896b-15a8-4e6a-89a7-a740c09b61be', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374db970-1bb3-4edb-b9f0-2b9f3ab3d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374db970-1bb3-4edb-b9f0-2b9f3ab3d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51442a9-65e7-4ca6-88f5-25b78efef962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:25 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume 5553896b-15a8-4e6a-89a7-a740c09b61be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5553896b-15a8-4e6a-89a7-a740c09b61be', 'volume_size': 1}
Jul 06 15:43:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (9baffa23-41f8-4922-ade8-c20edf91ced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0ee805-ed1c-4e9d-a353-e9714d291a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d9a398d9-2ccf-43a1-879e-7fcbb94a9217 tempest-VolumesActionsTest-1900291888 None] Acquiring lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" by "attach_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0ee805-ed1c-4e9d-a353-e9714d291a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2119721826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ff232b-031f-4a37-911b-5c824d8e4fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:26Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a7a12d-5de8-472f-8f2c-39bc25d66bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a7a12d-5de8-472f-8f2c-39bc25d66bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a91825d-9dc8-4d35-b6fb-bf9c71b6d021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a91825d-9dc8-4d35-b6fb-bf9c71b6d021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ff232b-031f-4a37-911b-5c824d8e4fe4', 'volume_name': 'volume-84ff232b-031f-4a37-911b-5c824d8e4fe4', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d09a4db-5dee-41f3-8de5-29e88ee07e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d09a4db-5dee-41f3-8de5-29e88ee07e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b2feab-b82f-4a0b-91f3-5029325bd4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:26 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume 84ff232b-031f-4a37-911b-5c824d8e4fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ff232b-031f-4a37-911b-5c824d8e4fe4', 'volume_size': 1}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d9a398d9-2ccf-43a1-879e-7fcbb94a9217 tempest-VolumesActionsTest-1900291888 None] Lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" acquired by "attach_volume" :: waited 0.081s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d9a398d9-2ccf-43a1-879e-7fcbb94a9217 tempest-VolumesActionsTest-1900291888 None] Attaching volume f12e7ba7-9d07-48f9-bf82-30ebc17647b5 to instance 2f9c98a5-acf6-4258-8fa2-c574972c6f71 at mountpoint /dev/vdb on host None.
Jul 06 15:43:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d9a398d9-2ccf-43a1-879e-7fcbb94a9217 tempest-VolumesActionsTest-1900291888 None] Attach volume completed successfully.
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d9a398d9-2ccf-43a1-879e-7fcbb94a9217 tempest-VolumesActionsTest-1900291888 None] Lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" released by "attach_volume" :: held 0.130s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:26 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d 1073741824" returned: 0 in 1.370s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (3bbd7c95-8748-41d7-b1e5-f416479ce92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:26 devstack sudo[102885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d
Jul 06 15:43:26 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1403a2-0928-440f-be48-dca85cf6528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1403a2-0928-440f-be48-dca85cf6528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561276540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e617021-4996-4710-a349-bf2851384f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:26Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad177592-50b6-4d2d-b1aa-879b73cc388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad177592-50b6-4d2d-b1aa-879b73cc388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546f6d9f-9c25-46f1-b0c7-c2045def4865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546f6d9f-9c25-46f1-b0c7-c2045def4865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e617021-4996-4710-a349-bf2851384f63', 'volume_name': 'volume-7e617021-4996-4710-a349-bf2851384f63', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e7c5ec-c614-4686-8d2a-ea5a15341725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e7c5ec-c614-4686-8d2a-ea5a15341725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8254936-2fd8-4513-82fd-fcd0e32a3073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:26 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume 7e617021-4996-4710-a349-bf2851384f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e617021-4996-4710-a349-bf2851384f63', 'volume_size': 1}
Jul 06 15:43:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (afdb7b53-57bd-4905-bb0a-12e27ab174df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fe095a-fab5-4a84-88f5-5cb2214e80b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6cb00fbf-554d-41cc-87cb-b2ce479bddd3 tempest-VolumesActionsTest-1900291888 None] Acquiring lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5-detach_volume" by "detach_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fe095a-fab5-4a84-88f5-5cb2214e80b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1951690914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54d6655-70a5-4c8e-b26d-a1e082d6a679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:27Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725970e0-94ef-43a8-bfde-c6b9d97378b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725970e0-94ef-43a8-bfde-c6b9d97378b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4415a450-6ce2-4db4-870a-911e19a38c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4415a450-6ce2-4db4-870a-911e19a38c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a54d6655-70a5-4c8e-b26d-a1e082d6a679', 'volume_name': 'volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f9770e-2bd8-4499-8f20-633cba474f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f9770e-2bd8-4499-8f20-633cba474f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2e64a7-b442-4a3c-9d25-f1172f67a980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:27 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume a54d6655-70a5-4c8e-b26d-a1e082d6a679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679', 'volume_size': 1}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6cb00fbf-554d-41cc-87cb-b2ce479bddd3 tempest-VolumesActionsTest-1900291888 None] Lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6cb00fbf-554d-41cc-87cb-b2ce479bddd3 tempest-VolumesActionsTest-1900291888 None] Detaching volume f12e7ba7-9d07-48f9-bf82-30ebc17647b5 from instance 2f9c98a5-acf6-4258-8fa2-c574972c6f71.
Jul 06 15:43:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6cb00fbf-554d-41cc-87cb-b2ce479bddd3 tempest-VolumesActionsTest-1900291888 None] Detach volume completed successfully.
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6cb00fbf-554d-41cc-87cb-b2ce479bddd3 tempest-VolumesActionsTest-1900291888 None] Lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:27 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d" returned: 0 in 0.779s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.777s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2071897318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5553896b-15a8-4e6a-89a7-a740c09b61be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:25Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Creating volume 5553896b-15a8-4e6a-89a7-a740c09b61be {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:43:27 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807243d4-a28d-4665-aff2-2474947ea701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e781c7-56cc-41bc-a529-471eeb8cc55d', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:27 devstack sudo[102888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be 1073741824
Jul 06 15:43:27 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff0189a-5e71-4679-ba1e-b5dccc630ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:27 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume volume-26e781c7-56cc-41bc-a529-471eeb8cc55d (26e781c7-56cc-41bc-a529-471eeb8cc55d): created successfully
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff0189a-5e71-4679-ba1e-b5dccc630ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (34b86419-97c6-41a8-b69f-84c7b8e88b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a49cc164-436d-4aff-a6b1-5eceaa54c938 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created volume successfully.
Jul 06 15:43:28 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be 1073741824" returned: 0 in 0.821s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:28 devstack sudo[102894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be
Jul 06 15:43:28 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:28 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be" returned: 0 in 0.609s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.627s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2119721826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ff232b-031f-4a37-911b-5c824d8e4fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:26Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Creating volume 84ff232b-031f-4a37-911b-5c824d8e4fe4 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:43:28 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:28 devstack sudo[102897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4 1073741824
Jul 06 15:43:28 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51442a9-65e7-4ca6-88f5-25b78efef962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5553896b-15a8-4e6a-89a7-a740c09b61be', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4f74ae-92c8-4882-9ed7-58a5a65cff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:28 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume volume-5553896b-15a8-4e6a-89a7-a740c09b61be (5553896b-15a8-4e6a-89a7-a740c09b61be): created successfully
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4f74ae-92c8-4882-9ed7-58a5a65cff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (b544d593-6481-4742-84cc-81d791b89d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:28 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-768af6dc-1125-416c-9adf-f9e925c2f7af tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created volume successfully.
Jul 06 15:43:29 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4 1073741824" returned: 0 in 0.793s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:29 devstack sudo[102916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4
Jul 06 15:43:29 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:30 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4" returned: 0 in 0.780s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.759s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561276540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e617021-4996-4710-a349-bf2851384f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:26Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Creating volume 7e617021-4996-4710-a349-bf2851384f63 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:43:30 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:30 devstack sudo[102931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63 1073741824
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b2feab-b82f-4a0b-91f3-5029325bd4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ff232b-031f-4a37-911b-5c824d8e4fe4', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:30 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f82d6c0-2c3e-4603-b410-d37c4bea08cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:30 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume volume-84ff232b-031f-4a37-911b-5c824d8e4fe4 (84ff232b-031f-4a37-911b-5c824d8e4fe4): created successfully
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f82d6c0-2c3e-4603-b410-d37c4bea08cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (9baffa23-41f8-4922-ade8-c20edf91ced0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:30 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-860c2c8e-71ca-4bda-b955-f484128ed08f tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created volume successfully.
Jul 06 15:43:31 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63 1073741824" returned: 0 in 0.850s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:31 devstack sudo[102938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63
Jul 06 15:43:31 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:31 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63" returned: 0 in 0.624s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.817s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1951690914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54d6655-70a5-4c8e-b26d-a1e082d6a679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a26c7486a4a4cf4a7bab8436a1fa637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:27Z,use_quota=True,user_id='571c056f8d9f40d3b51dae8d31fb42b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Creating volume a54d6655-70a5-4c8e-b26d-a1e082d6a679 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:43:32 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8254936-2fd8-4513-82fd-fcd0e32a3073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e617021-4996-4710-a349-bf2851384f63', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:32 devstack sudo[102941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679 1073741824
Jul 06 15:43:32 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a59353f-1563-404f-b85e-8985996574a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:32 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume volume-7e617021-4996-4710-a349-bf2851384f63 (7e617021-4996-4710-a349-bf2851384f63): created successfully
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a59353f-1563-404f-b85e-8985996574a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (3bbd7c95-8748-41d7-b1e5-f416479ce92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c307e1a5-f62a-4785-902b-bc42d9ed2c71 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created volume successfully.
Jul 06 15:43:32 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679 1073741824" returned: 0 in 0.832s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:32 devstack sudo[102947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679
Jul 06 15:43:32 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:33 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679" returned: 0 in 0.606s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2e64a7-b442-4a3c-9d25-f1172f67a980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a89aeb4-31f4-4a63-8fad-88a8db5d7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:33 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Volume volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679 (a54d6655-70a5-4c8e-b26d-a1e082d6a679): created successfully
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a89aeb4-31f4-4a63-8fad-88a8db5d7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Flow 'volume_create_manager' (afdb7b53-57bd-4905-bb0a-12e27ab174df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-61f61431-0f17-4aac-9a0b-7156a67d0c26 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created volume successfully.
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-a54d6655-70a5-4c8e-b26d-a1e082d6a679-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-a54d6655-70a5-4c8e-b26d-a1e082d6a679-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-quobyte-a54d6655-70a5-4c8e-b26d-a1e082d6a679" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-a54d6655-70a5-4c8e-b26d-a1e082d6a679" acquired by "delete_volume" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e466d29-c14c-45f7-8a9f-90a042342927]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:33 devstack sudo[102950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679
Jul 06 15:43:33 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:34 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679" returned: 0 in 0.716s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:34 devstack sudo[102955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679
Jul 06 15:43:34 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:35 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a54d6655-70a5-4c8e-b26d-a1e082d6a679" returned: 0 in 0.660s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-a54d6655-70a5-4c8e-b26d-a1e082d6a679" released by "delete_volume" :: held 1.419s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created reservations ['dccd4b17-bdb8-4e5f-8483-179c0089613c', 'ea37cbe2-e347-4795-ab1f-78f83358da31', '33d9b162-a7d4-4fba-b3ce-cfb52fd611f0', '70098b49-d17d-4a55-998e-c55aca397688'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:35 devstack sudo[102958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:43:35 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-7e617021-4996-4710-a349-bf2851384f63-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-7e617021-4996-4710-a349-bf2851384f63-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-quobyte-7e617021-4996-4710-a349-bf2851384f63" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-7e617021-4996-4710-a349-bf2851384f63" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:35 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.695s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:43:35 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Deleted volume successfully.
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c99f8d-2dc8-4c50-a248-b491b73f11a8]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa703f1a-b408-4be8-9a86-78cd361dd213 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-a54d6655-70a5-4c8e-b26d-a1e082d6a679-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:36 devstack sudo[102961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63
Jul 06 15:43:36 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:36 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42e28fa-7d55-487b-be79-1392cc1cc7fe]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:36 devstack sudo[102963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5
Jul 06 15:43:36 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:36 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63" returned: 0 in 0.762s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:36 devstack sudo[102968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63
Jul 06 15:43:36 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:37 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" returned: 0 in 0.743s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8674b78-2ce8-4a95-8be9-528e32cec4f7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:37 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7e617021-4996-4710-a349-bf2851384f63" returned: 0 in 0.609s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-7e617021-4996-4710-a349-bf2851384f63" released by "delete_volume" :: held 1.417s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:37 devstack sudo[102974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5
Jul 06 15:43:37 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created reservations ['7fd19817-6b3e-4a96-a66b-d361c4207b50', '5babda23-fdf2-4549-8e6c-e90e0e8aebd8', 'f18f0342-416c-4857-9395-bbad517f6466', '5a66b970-d0d1-4d18-8cc9-4c6995bc13b8'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:37 devstack sudo[102976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:43:37 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:38 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" returned: 0 in 0.744s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.d9e0eea2-e757-4645-96f6-cf396d48e4b56957ptg8.img {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:38 devstack sudo[102982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.d9e0eea2-e757-4645-96f6-cf396d48e4b56957ptg8.img
Jul 06 15:43:38 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-84ff232b-031f-4a37-911b-5c824d8e4fe4-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-84ff232b-031f-4a37-911b-5c824d8e4fe4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:38 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.641s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:43:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Deleted volume successfully.
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-quobyte-84ff232b-031f-4a37-911b-5c824d8e4fe4" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a1eec932-eec0-4d8b-88ee-94771e856820 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-7e617021-4996-4710-a349-bf2851384f63-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-84ff232b-031f-4a37-911b-5c824d8e4fe4" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1338e7a9-b3d1-4351-a272-141330d1f387]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:38 devstack sudo[102984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4
Jul 06 15:43:38 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:39 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4" returned: 0 in 0.925s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:39 devstack sudo[102999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4
Jul 06 15:43:39 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:40 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-84ff232b-031f-4a37-911b-5c824d8e4fe4" returned: 0 in 1.025s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-84ff232b-031f-4a37-911b-5c824d8e4fe4" released by "delete_volume" :: held 2.008s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created reservations ['4b64768e-47d5-4fe5-aebf-082fb566d02b', '7d6413cd-8c59-4d1f-856f-55a462ad2d72', '0c25afae-ad7e-4225-bb48-d19e1b3b9923', '3613db6d-b6bb-48b6-9742-9b742713a144'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:40 devstack sudo[103004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:43:40 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-5553896b-15a8-4e6a-89a7-a740c09b61be-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-5553896b-15a8-4e6a-89a7-a740c09b61be-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-quobyte-5553896b-15a8-4e6a-89a7-a740c09b61be" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-5553896b-15a8-4e6a-89a7-a740c09b61be" acquired by "delete_volume" :: waited 0.046s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[7336be55-1405-43f5-ba46-ccf4495752e2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:41 devstack sudo[103006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be
Jul 06 15:43:41 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:41 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.233s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:41 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:43:41 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Deleted volume successfully.
Jul 06 15:43:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-874ed057-3a22-4ccb-b3e9-cec9b2b68dff tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-84ff232b-031f-4a37-911b-5c824d8e4fe4-delete_volume" released by "delete_volume" :: held 3.717s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:42 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be" returned: 0 in 1.866s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:42 devstack sudo[103012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be
Jul 06 15:43:42 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:42 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.d9e0eea2-e757-4645-96f6-cf396d48e4b56957ptg8.img" returned: 0 in 4.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:42 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b953eac0-822e-427e-b4cf-d16d7bdf939e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:42 devstack sudo[103014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5
Jul 06 15:43:42 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:43 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5553896b-15a8-4e6a-89a7-a740c09b61be" returned: 0 in 0.618s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-5553896b-15a8-4e6a-89a7-a740c09b61be" released by "delete_volume" :: held 2.568s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created reservations ['172d3b80-5abb-4182-83f8-c11ab1187a81', '9ffccb12-990b-4938-8b70-5406252f0f98', '43f4f5df-91c2-4990-9fd9-f607bf31e7b0', '0870c3f7-1bec-4b87-a533-280dafdf7c6c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:43 devstack sudo[103019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:43:43 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:43 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" returned: 0 in 0.938s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.d9e0eea2-e757-4645-96f6-cf396d48e4b56957ptg8.img {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:43:43 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Converted 1024.00 MB image at 212.60 MB/s
Jul 06 15:43:43 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] d9e0eea2-e757-4645-96f6-cf396d48e4b5 was raw, no need to convert to raw {{(pid=86249) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 06 15:43:44 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.647s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:44 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:43:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-26e781c7-56cc-41bc-a529-471eeb8cc55d-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:44 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Deleted volume successfully.
Jul 06 15:43:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-26e781c7-56cc-41bc-a529-471eeb8cc55d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-de7e0546-95dc-43c5-8db3-5f4584ae8d68 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-5553896b-15a8-4e6a-89a7-a740c09b61be-delete_volume" released by "delete_volume" :: held 3.579s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-quobyte-26e781c7-56cc-41bc-a529-471eeb8cc55d" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-26e781c7-56cc-41bc-a529-471eeb8cc55d" acquired by "delete_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:44 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[e291a0df-9bd6-4274-8c4c-4ed1edd22d4f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:44 devstack sudo[103025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d
Jul 06 15:43:44 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:45 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d" returned: 0 in 0.788s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:45 devstack sudo[103031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d
Jul 06 15:43:45 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:45 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-26e781c7-56cc-41bc-a529-471eeb8cc55d" returned: 0 in 0.639s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-26e781c7-56cc-41bc-a529-471eeb8cc55d" released by "delete_volume" :: held 1.476s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created reservations ['40a66dfa-4e6b-4be1-a390-a48d54664936', '9a7d2f50-7d71-4acf-8820-d20f8f219247', '2f00d482-1eb0-479c-acb6-a93c8f639425', '782a10b9-ba06-4ac2-83ce-0d0c96f5027c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:45 devstack sudo[103034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:43:45 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-513caaae-c5e7-4e14-b93c-b9dec1a83a0b-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-513caaae-c5e7-4e14-b93c-b9dec1a83a0b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "cinder-quobyte-513caaae-c5e7-4e14-b93c-b9dec1a83a0b" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:43:46 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-513caaae-c5e7-4e14-b93c-b9dec1a83a0b" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:43:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.715s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:46 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:43:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Deleted volume successfully.
Jul 06 15:43:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[294d989a-0724-44f0-a1f5-884debfad3a4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:43:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f27f775b-9788-4854-8f83-04ff17fce197 tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-26e781c7-56cc-41bc-a529-471eeb8cc55d-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:46 devstack sudo[103037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b
Jul 06 15:43:46 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:47 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b" returned: 0 in 0.771s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:47 devstack sudo[103042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b
Jul 06 15:43:47 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:48 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-513caaae-c5e7-4e14-b93c-b9dec1a83a0b" returned: 0 in 0.653s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-quobyte-513caaae-c5e7-4e14-b93c-b9dec1a83a0b" released by "delete_volume" :: held 1.476s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Created reservations ['51fd1319-9e29-4b3e-88cb-0cb8f44196ee', '2aec438f-4727-4bf3-9243-71766bcf0ae5', 'b9e749ee-b292-42b6-aa23-25c831e0b63c', '56315d40-ebd3-4bcb-a9b5-47b9edc6f947'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:43:48 devstack sudo[103045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:43:48 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:43:48 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.720s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:43:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Deleted volume successfully.
Jul 06 15:43:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ba7efbb7-1c88-4960-bc5f-3977979374be tempest-CreateVolumesFromSourceVolumeTest-1121021529 None] Lock "cinder-513caaae-c5e7-4e14-b93c-b9dec1a83a0b-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Flow 'volume_create_manager' (d72fdef6-19df-4827-959b-ec2bf831a2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae266c23-2c9f-4476-8463-b690af439c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae266c23-2c9f-4476-8463-b690af439c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2057174497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b47d74d-079a-4028-93c5-dfb2d1ee87f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4ff40605224d5aaa3d290433fc2359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:52Z,use_quota=True,user_id='ba500a0e51ee4fe8987beb50fde5a2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab7f0e4-a18e-4d65-aefb-604c821cd222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab7f0e4-a18e-4d65-aefb-604c821cd222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2d39f8-3b84-416b-9a62-a460bf2e2541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2d39f8-3b84-416b-9a62-a460bf2e2541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b47d74d-079a-4028-93c5-dfb2d1ee87f9', 'volume_name': 'volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0ce72a-4be8-4330-8e87-9316796902ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0ce72a-4be8-4330-8e87-9316796902ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f46f802-4a12-49e5-b55b-027f5bba2d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:43:51 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Volume 5b47d74d-079a-4028-93c5-dfb2d1ee87f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9', 'volume_size': 1}
Jul 06 15:43:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:43:58 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=72,cinder:SELECT=44,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:44:01 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=59,cinder:UPDATE=68,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.598s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Uploaded volume to glance image-id: d9e0eea2-e757-4645-96f6-cf396d48e4b5. {{(pid=86249) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.177s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2057174497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b47d74d-079a-4028-93c5-dfb2d1ee87f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4ff40605224d5aaa3d290433fc2359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:52Z,use_quota=True,user_id='ba500a0e51ee4fe8987beb50fde5a2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Creating volume 5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:44:03 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:03 devstack sudo[103052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 1073741824
Jul 06 15:44:03 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:03 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-363491bf-d1f9-4ed7-af30-27393ce37b0d tempest-VolumesActionsTest-1900291888 None] Copy volume to image completed successfully.
Jul 06 15:44:03 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 1073741824" returned: 0 in 0.783s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:03 devstack sudo[103058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9
Jul 06 15:44:03 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:04 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" returned: 0 in 0.630s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.203s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f46f802-4a12-49e5-b55b-027f5bba2d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac5fed1-2509-44f8-9226-28a311209958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[153015f3-1c55-473b-89ad-9d9511b81041]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:04 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Volume volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 (5b47d74d-079a-4028-93c5-dfb2d1ee87f9): created successfully
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac5fed1-2509-44f8-9226-28a311209958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Flow 'volume_create_manager' (d72fdef6-19df-4827-959b-ec2bf831a2aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:04 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e0832244-f369-4138-a628-97843ccda121 tempest-VolumeDependencyTests-551122858 None] Created volume successfully.
Jul 06 15:44:04 devstack sudo[103061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5
Jul 06 15:44:04 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:05 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" returned: 0 in 0.717s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:05 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[438fb900-af27-4420-b250-37d565ba2c61]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:05 devstack sudo[103066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5
Jul 06 15:44:05 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:06 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" returned: 0 in 0.727s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:06 devstack sudo[103071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img
Jul 06 15:44:06 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:44:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:06 devstack sudo[103083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:44:06 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:08 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 2.142s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:08 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:44:08 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:44:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:44:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:44:10 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img" returned: 0 in 4.087s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:10 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[434672bd-5f84-44e4-ad48-043c35ae1d0e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:10 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5
Jul 06 15:44:10 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:11 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" returned: 0 in 0.920s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:11 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:44:11 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Converted 1024.00 MB image at 250.50 MB/s
Jul 06 15:44:11 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] 1f215f32-1e8d-4780-8712-71f1f0bfc0ac was raw, converting to qcow2 {{(pid=86249) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 06 15:44:11 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b78efa-db19-43fa-9ccd-7588de89217c]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:11 devstack sudo[103096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img
Jul 06 15:44:11 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:11 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img" returned: 0 in 0.687s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:11 devstack sudo[103100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img
Jul 06 15:44:11 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:12 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img" returned: 1 in 0.666s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:44:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img /opt/stack/data/cinder/conversion/vol_upload_odjevogs {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:12 devstack sudo[103105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img /opt/stack/data/cinder/conversion/vol_upload_odjevogs
Jul 06 15:44:12 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:13 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img /opt/stack/data/cinder/conversion/vol_upload_odjevogs" returned: 0 in 0.610s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:13 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Image conversion details: src /opt/stack/data/cinder/conversion/f12e7ba7-9d07-48f9-bf82-30ebc17647b5.temp_image.1f215f32-1e8d-4780-8712-71f1f0bfc0ac77dg88l5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_odjevogs {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:44:13 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 06 15:44:13 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[db347fcc-643a-4a24-8367-274b4f64ba56]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_odjevogs {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:13 devstack sudo[103111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_odjevogs
Jul 06 15:44:13 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:13 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_odjevogs" returned: 0 in 0.685s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.444s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Uploaded volume to glance image-id: 1f215f32-1e8d-4780-8712-71f1f0bfc0ac. {{(pid=86249) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 06 15:44:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.240s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Creating offline snapshot 356f546a-88d2-44bc-b754-4665605ea5a0 of volume 5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:44:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-73856169-b309-4f15-9256-482f8f3d3a93 tempest-VolumesActionsTest-1900291888 None] Copy volume to image completed successfully.
Jul 06 15:44:15 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb550de4-b152-4d2c-a838-5cedb7bffc39]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:15 devstack sudo[103152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9
Jul 06 15:44:15 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:15 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" returned: 0 in 0.722s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:15 devstack sudo[103157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 1G
Jul 06 15:44:15 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Acquiring lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Acquiring lock "cinder-quobyte-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Lock "cinder-quobyte-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:16 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7850f53-22e6-4895-9c59-20a2441bd2c7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:16 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 1G" returned: 0 in 0.874s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:16 devstack sudo[103164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0
Jul 06 15:44:16 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:16 devstack sudo[103163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5
Jul 06 15:44:16 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:17 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0" returned: 0 in 0.687s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:17 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 is being set with open permissions: ugo+rw
Jul 06 15:44:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:17 devstack sudo[103173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0
Jul 06 15:44:17 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:17 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" returned: 0 in 0.757s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:17 devstack sudo[103175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5
Jul 06 15:44:17 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:17 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0" returned: 0 in 0.640s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:18 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" returned: 0 in 0.624s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:18 devstack sudo[103179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.info
Jul 06 15:44:18 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Lock "cinder-quobyte-f12e7ba7-9d07-48f9-bf82-30ebc17647b5" released by "delete_volume" :: held 1.423s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Created reservations ['b3e4acb7-6c94-43ca-81ba-0861f277d3ca', '8272593e-02c4-4055-9e3e-1fc790dc50f4', '894dcd4d-aef3-46b9-8565-e4e2456c8509', '2653849c-f268-439b-bd89-305dd1a148f6'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:18 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:44:18 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:18 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.info" returned: 0 in 0.643s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:18 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.info is being set with open permissions: ugo+rw
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:18 devstack sudo[103184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.info
Jul 06 15:44:18 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:18 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.634s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:44:18 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Deleted volume successfully.
Jul 06 15:44:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-539b615e-85e0-4a58-ad39-eb3b81bfc46a tempest-VolumesActionsTest-1900291888 None] Lock "cinder-f12e7ba7-9d07-48f9-bf82-30ebc17647b5-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:19 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.info" returned: 0 in 0.617s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.280s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:19 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9f8c0e11-5e54-41f6-adc7-26fd5fb3ecc1 tempest-VolumeDependencyTests-551122858 None] Create snapshot completed successfully
Jul 06 15:44:20 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Flow 'volume_create_manager' (98542845-e52a-4ddc-993f-b6b0e846afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41dc6107-a8e8-41ae-9f5c-3ed4ca10b8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41dc6107-a8e8-41ae-9f5c-3ed4ca10b8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1977993379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f401b3cc-61cb-411f-8b62-87df2bd214de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4ff40605224d5aaa3d290433fc2359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=356f546a-88d2-44bc-b754-4665605ea5a0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:21Z,use_quota=True,user_id='ba500a0e51ee4fe8987beb50fde5a2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b727a51-eee8-400c-96a2-2d00c6b1aa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b727a51-eee8-400c-96a2-2d00c6b1aa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf0a9f9-16e5-4695-93a8-a220cea7f838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf0a9f9-16e5-4695-93a8-a220cea7f838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f401b3cc-61cb-411f-8b62-87df2bd214de', 'volume_name': 'volume-f401b3cc-61cb-411f-8b62-87df2bd214de', 'volume_size': 1, 'snapshot_id': '356f546a-88d2-44bc-b754-4665605ea5a0'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241da274-f0ff-44a3-86a3-84167b2f1742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241da274-f0ff-44a3-86a3-84167b2f1742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53fcb39-ce40-4e5a-a7a1-43208a6316af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:21 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Volume f401b3cc-61cb-411f-8b62-87df2bd214de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f401b3cc-61cb-411f-8b62-87df2bd214de', 'volume_size': 1, 'snapshot_id': '356f546a-88d2-44bc-b754-4665605ea5a0'}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "cinder-quobyte-356f546a-88d2-44bc-b754-4665605ea5a0-f401b3cc-61cb-411f-8b62-87df2bd214de" by "_create_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-356f546a-88d2-44bc-b754-4665605ea5a0-f401b3cc-61cb-411f-8b62-87df2bd214de" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Creating volume f401b3cc-61cb-411f-8b62-87df2bd214de from snapshot 356f546a-88d2-44bc-b754-4665605ea5a0 {{(pid=86249) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "cinder-quobyte-f401b3cc-61cb-411f-8b62-87df2bd214de" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-f401b3cc-61cb-411f-8b62-87df2bd214de" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] snapshot: 356f546a-88d2-44bc-b754-4665605ea5a0, volume: f401b3cc-61cb-411f-8b62-87df2bd214de,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[87283ab4-f6d5-486a-805b-5e155aca57c8]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:21 devstack sudo[103190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0
Jul 06 15:44:21 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:22 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0" returned: 0 in 0.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:44:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:44:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:44:22 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a2f28c-b9fd-49be-b185-2228bcb7dd5e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:22 devstack sudo[103196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9
Jul 06 15:44:22 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:22 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" returned: 0 in 0.793s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:22 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:44:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:22 devstack sudo[103201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de
Jul 06 15:44:22 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (0b224c79-f959-4cec-b834-4c023ae8ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e85d38-8d1b-4292-94a8-0b4857baaa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e85d38-8d1b-4292-94a8-0b4857baaa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1577977065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82872cd-fac8-40b6-9a56-fcf9841c9ad5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:26Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06b29d8-209c-454a-9774-6456b4f6aa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06b29d8-209c-454a-9774-6456b4f6aa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412f9c18-92e5-4255-b14a-9e5255ec0030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412f9c18-92e5-4255-b14a-9e5255ec0030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82872cd-fac8-40b6-9a56-fcf9841c9ad5', 'volume_name': 'volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392a40dd-8cb0-49b2-804c-1c211500c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392a40dd-8cb0-49b2-804c-1c211500c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736c6ffd-3c56-41ce-a7ce-6094cfee5cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:25 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Volume c82872cd-fac8-40b6-9a56-fcf9841c9ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5', 'volume_size': 1}
Jul 06 15:44:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:27 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de" returned: 0 in 4.775s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:27 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a337ba1-db39-460e-95d1-9b14ea4fdac0]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:27 devstack sudo[103219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9
Jul 06 15:44:27 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:28 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" returned: 0 in 0.884s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:28 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:44:28 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Converted 1024.00 MB image at 214.39 MB/s
Jul 06 15:44:28 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de is being set with open permissions: ugo+rw
Jul 06 15:44:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:28 devstack sudo[103224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de
Jul 06 15:44:28 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:29 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de" returned: 0 in 0.657s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-f401b3cc-61cb-411f-8b62-87df2bd214de" released by "_copy_volume_from_snapshot" :: held 8.046s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-356f546a-88d2-44bc-b754-4665605ea5a0-f401b3cc-61cb-411f-8b62-87df2bd214de" released by "_create_volume_from_snapshot" :: held 8.072s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.086s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.254s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1577977065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82872cd-fac8-40b6-9a56-fcf9841c9ad5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:26Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Creating volume c82872cd-fac8-40b6-9a56-fcf9841c9ad5 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:44:29 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:29 devstack sudo[103227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5 1073741824
Jul 06 15:44:29 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53fcb39-ce40-4e5a-a7a1-43208a6316af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f401b3cc-61cb-411f-8b62-87df2bd214de', 'volume_size': 1, 'snapshot_id': '356f546a-88d2-44bc-b754-4665605ea5a0'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdb9689-d15b-4d8e-881e-91a36565c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:29 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Volume volume-f401b3cc-61cb-411f-8b62-87df2bd214de (f401b3cc-61cb-411f-8b62-87df2bd214de): created successfully
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdb9689-d15b-4d8e-881e-91a36565c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Flow 'volume_create_manager' (98542845-e52a-4ddc-993f-b6b0e846afaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:29 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ca84afe0-a9d0-4a33-90ba-ba931b823802 tempest-VolumeDependencyTests-551122858 None] Created volume successfully.
Jul 06 15:44:29 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5 1073741824" returned: 0 in 0.784s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:30 devstack sudo[103233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5
Jul 06 15:44:30 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "cinder-356f546a-88d2-44bc-b754-4665605ea5a0-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-356f546a-88d2-44bc-b754-4665605ea5a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "cinder-quobyte-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "cinder-quobyte-356f546a-88d2-44bc-b754-4665605ea5a0" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-356f546a-88d2-44bc-b754-4665605ea5a0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Deleting offline snapshot 356f546a-88d2-44bc-b754-4665605ea5a0 of volume 5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] snapshot_file for this snap is: volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebdf1ae-51be-4850-9c4e-0ca42ebd92ac]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:30 devstack sudo[103236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0
Jul 06 15:44:30 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:30 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5" returned: 0 in 0.637s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736c6ffd-3c56-41ce-a7ce-6094cfee5cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8c1c48-6300-434f-8e2c-4dad49631b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:30 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Volume volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5 (c82872cd-fac8-40b6-9a56-fcf9841c9ad5): created successfully
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8c1c48-6300-434f-8e2c-4dad49631b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (0b224c79-f959-4cec-b834-4c023ae8ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:30 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-615a9cd5-c017-40ed-b607-78836f3cc98e tempest-VolumesGetTest-41872445 None] Created volume successfully.
Jul 06 15:44:30 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0" returned: 0 in 0.748s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36af935-c279-4866-8eb1-8a06ede23642]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:31 devstack sudo[103242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9
Jul 06 15:44:31 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (dca6e5d8-d5b3-4ef3-aef7-f3d1426d7479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d129de-6727-4e78-9286-cb6919f828bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d129de-6727-4e78-9286-cb6919f828bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:44:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-499461279',display_name='tempest-VolumesGetTest-Volume-1299837367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fb24d5-b25c-4317-ab0a-264c87ea551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:32Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f3e85e-cd7d-4208-9ebf-7c5e07f3ed3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f3e85e-cd7d-4208-9ebf-7c5e07f3ed3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce54a6f-1c1f-4f6c-9f3b-9c9bc23e131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce54a6f-1c1f-4f6c-9f3b-9c9bc23e131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2fb24d5-b25c-4317-ab0a-264c87ea551f', 'volume_name': 'volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbeb17af-f24c-4f25-ab0d-488497e0e962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbeb17af-f24c-4f25-ab0d-488497e0e962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0916e28b-4299-4cf1-8203-5954fb645751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:31 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Volume d2fb24d5-b25c-4317-ab0a-264c87ea551f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f', 'volume_size': 1}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:44:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-499461279',display_name='tempest-VolumesGetTest-Volume-1299837367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fb24d5-b25c-4317-ab0a-264c87ea551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:32Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Creating volume d2fb24d5-b25c-4317-ab0a-264c87ea551f {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:31 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:44:31 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" returned: 0 in 0.777s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:31 devstack sudo[103247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f 1073741824
Jul 06 15:44:31 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:31 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0
Jul 06 15:44:31 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:32 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0" returned: 0 in 0.760s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:32 devstack sudo[103258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0
Jul 06 15:44:32 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:32 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f 1073741824" returned: 0 in 0.816s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:32 devstack sudo[103260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f
Jul 06 15:44:32 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:33 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9.356f546a-88d2-44bc-b754-4665605ea5a0" returned: 0 in 0.703s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:33 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f" returned: 0 in 0.661s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-356f546a-88d2-44bc-b754-4665605ea5a0" released by "_delete_snapshot" :: held 3.098s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0916e28b-4299-4cf1-8203-5954fb645751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ba3e6e-7684-43b3-95ab-5e5a5e45242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" released by "delete_snapshot" :: held 3.129s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:33 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Volume volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f (d2fb24d5-b25c-4317-ab0a-264c87ea551f): created successfully
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ba3e6e-7684-43b3-95ab-5e5a5e45242a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (dca6e5d8-d5b3-4ef3-aef7-f3d1426d7479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-10d21d07-21d1-4805-bc23-f433b3b33ccb tempest-VolumesGetTest-41872445 None] Created volume successfully.
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Created reservations ['9d505348-b189-4bf4-bacb-929c918b9da5', '3c5e66c5-167d-4621-a36a-097a01e925f7', '4c2ae4a0-a8c7-4c66-8302-6d90eda69ba9', '965106fc-31f9-45bf-91cb-0db772c7cda7'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:44:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Delete snapshot completed successfully.
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fe529755-c91c-416f-a579-0e8842019334 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-356f546a-88d2-44bc-b754-4665605ea5a0-delete_snapshot" released by "delete_snapshot" :: held 3.273s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-d2fb24d5-b25c-4317-ab0a-264c87ea551f-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Lock "cinder-d2fb24d5-b25c-4317-ab0a-264c87ea551f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-quobyte-d2fb24d5-b25c-4317-ab0a-264c87ea551f" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-d2fb24d5-b25c-4317-ab0a-264c87ea551f" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f98a6b5-60d2-4a4f-ac97-9e3d6821ed79]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:34 devstack sudo[103264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f
Jul 06 15:44:34 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "cinder-5b47d74d-079a-4028-93c5-dfb2d1ee87f9-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-5b47d74d-079a-4028-93c5-dfb2d1ee87f9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "cinder-quobyte-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:34 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce77d42f-4636-4071-bd92-7979fa40bd8b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:34 devstack sudo[103266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9
Jul 06 15:44:34 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:34 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f" returned: 0 in 0.734s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:34 devstack sudo[103271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f
Jul 06 15:44:34 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:35 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" returned: 0 in 0.749s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:35 devstack sudo[103277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9
Jul 06 15:44:35 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:35 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d2fb24d5-b25c-4317-ab0a-264c87ea551f" returned: 0 in 0.647s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-d2fb24d5-b25c-4317-ab0a-264c87ea551f" released by "delete_volume" :: held 1.425s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Created reservations ['681fd89f-cea5-4a07-8f7f-6c5d5931c359', 'ada393a5-71e0-4c1b-898b-24c2d77a245e', 'a1f26159-f132-403a-927a-3cda04ed67b5', 'e6b2b92e-b82a-48d2-83b9-07a0ccf38925'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:35 devstack sudo[103279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:44:35 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:35 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" returned: 0 in 0.607s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-5b47d74d-079a-4028-93c5-dfb2d1ee87f9" released by "delete_volume" :: held 1.415s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Created reservations ['a90d7e6a-3a27-46d5-8819-8e5976351900', '4564bf3d-f8cb-4517-b6e9-fb30b5c337aa', '8929a46a-affd-4131-bd04-8253369ca981', '80b78fe6-7696-43f3-aea0-100c0621eec2'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:36 devstack sudo[103282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:44:36 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:36 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.672s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:44:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Deleted volume successfully.
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-c82872cd-fac8-40b6-9a56-fcf9841c9ad5-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Lock "cinder-c82872cd-fac8-40b6-9a56-fcf9841c9ad5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9df75337-7f44-4610-8c38-162b6bf625ea tempest-VolumesGetTest-41872445 None] Lock "cinder-d2fb24d5-b25c-4317-ab0a-264c87ea551f-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-quobyte-c82872cd-fac8-40b6-9a56-fcf9841c9ad5" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-c82872cd-fac8-40b6-9a56-fcf9841c9ad5" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94aebdc-b27f-4c32-bf81-f3d39ea6fcc3]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:36 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5
Jul 06 15:44:36 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "cinder-f401b3cc-61cb-411f-8b62-87df2bd214de-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:36 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.697s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-f401b3cc-61cb-411f-8b62-87df2bd214de-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Deleted volume successfully.
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-444f7445-0892-4684-812e-4145389a7148 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-5b47d74d-079a-4028-93c5-dfb2d1ee87f9-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "cinder-quobyte-f401b3cc-61cb-411f-8b62-87df2bd214de" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-f401b3cc-61cb-411f-8b62-87df2bd214de" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6882f029-92f6-4269-a699-895efe090672]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:36 devstack sudo[103288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de
Jul 06 15:44:36 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:37 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5" returned: 0 in 0.788s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:37 devstack sudo[103293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5
Jul 06 15:44:37 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:37 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de" returned: 0 in 0.756s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:37 devstack sudo[103298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de
Jul 06 15:44:37 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:37 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c82872cd-fac8-40b6-9a56-fcf9841c9ad5" returned: 0 in 0.617s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-c82872cd-fac8-40b6-9a56-fcf9841c9ad5" released by "delete_volume" :: held 1.453s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Created reservations ['792f2b26-1ec5-46f8-882b-40cf79e82be7', 'a063b97d-d202-4774-89a1-a48a0bf495d8', '60fd63ea-c0d9-4174-a020-20b44d0a1f2f', 'cf4e4d51-4bed-4833-869e-99d99019f41d'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:37 devstack sudo[103301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:44:37 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:38 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f401b3cc-61cb-411f-8b62-87df2bd214de" returned: 0 in 0.640s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-quobyte-f401b3cc-61cb-411f-8b62-87df2bd214de" released by "delete_volume" :: held 1.437s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Created reservations ['2fe61490-392d-40a2-9cb9-9a08f46cbf0b', 'b48488c7-d145-41f9-8004-8c6fcc2739e3', 'f8164a33-a3d2-41fd-9926-19c7f6dbc2ae', '8103021e-580e-49ed-a237-66fff3315f28'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:38 devstack sudo[103304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:44:38 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:38 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.671s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:44:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Deleted volume successfully.
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2c4b3b50-b9e2-44e7-acfb-706a14e16b2e tempest-VolumesGetTest-41872445 None] Lock "cinder-c82872cd-fac8-40b6-9a56-fcf9841c9ad5-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (a2a39226-7e5b-43c6-9278-14f6e2c58d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681fe255-d58b-4578-9a7c-cccf73859a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681fe255-d58b-4578-9a7c-cccf73859a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-31884147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55315cba-1eb2-4168-b550-7ec9d2538112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:39Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da919c29-916e-423c-b217-c893a6b0d77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da919c29-916e-423c-b217-c893a6b0d77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27696dc-fd1a-4da5-939f-52bbe9ee6837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27696dc-fd1a-4da5-939f-52bbe9ee6837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55315cba-1eb2-4168-b550-7ec9d2538112', 'volume_name': 'volume-55315cba-1eb2-4168-b550-7ec9d2538112', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277f5963-1a20-4d46-974e-e68f6f06e7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277f5963-1a20-4d46-974e-e68f6f06e7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77898a2-2e8a-4017-951b-3e0b04396426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:38 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Volume 55315cba-1eb2-4168-b550-7ec9d2538112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55315cba-1eb2-4168-b550-7ec9d2538112', 'volume_size': 1}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-31884147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55315cba-1eb2-4168-b550-7ec9d2538112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:39Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Creating volume 55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:44:38 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:44:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:38 devstack sudo[103308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 1073741824
Jul 06 15:44:38 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:39 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.680s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:39 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:44:39 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Deleted volume successfully.
Jul 06 15:44:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a2ac07-1856-47e2-9c60-4fd38d65ae22 tempest-VolumeDependencyTests-551122858 None] Lock "cinder-f401b3cc-61cb-411f-8b62-87df2bd214de-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:39 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 1073741824" returned: 0 in 0.885s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:39 devstack sudo[103314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112
Jul 06 15:44:39 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:40 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112" returned: 0 in 0.640s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:44:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77898a2-2e8a-4017-951b-3e0b04396426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55315cba-1eb2-4168-b550-7ec9d2538112', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b18e0df-4ef8-48f1-a8e4-6b0b139c06c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:40 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Volume volume-55315cba-1eb2-4168-b550-7ec9d2538112 (55315cba-1eb2-4168-b550-7ec9d2538112): created successfully
Jul 06 15:44:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b18e0df-4ef8-48f1-a8e4-6b0b139c06c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (a2a39226-7e5b-43c6-9278-14f6e2c58d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:40 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e2088ba4-5889-4ce0-9c49-ff742916a7f1 tempest-VolumesGetTest-41872445 None] Created volume successfully.
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (f5b4c0be-d1bf-4f6d-951a-628bb80eb21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e72e81e-7885-4a80-8417-cc56b33268e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e72e81e-7885-4a80-8417-cc56b33268e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1812143250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c72102-db23-47d7-950f-66b314abab41,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=55315cba-1eb2-4168-b550-7ec9d2538112,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:41Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b07327b-dc5b-42ba-97a9-d07d64aafb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b07327b-dc5b-42ba-97a9-d07d64aafb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2111d9af-c329-4db1-b6a0-02d479d285a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2111d9af-c329-4db1-b6a0-02d479d285a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f6c72102-db23-47d7-950f-66b314abab41', 'volume_name': 'volume-f6c72102-db23-47d7-950f-66b314abab41', 'volume_size': 1, 'source_volid': '55315cba-1eb2-4168-b550-7ec9d2538112', 'source_volstatus': 'available'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a5daf8-b29f-443b-8e30-055a86a3a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a5daf8-b29f-443b-8e30-055a86a3a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55f9e11-bd76-43bd-997b-1024e86fabba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:41 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Volume f6c72102-db23-47d7-950f-66b314abab41: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f6c72102-db23-47d7-950f-66b314abab41', 'volume_size': 1, 'source_volid': '55315cba-1eb2-4168-b550-7ec9d2538112', 'source_volstatus': 'available'}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:41 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Cloning volume 55315cba-1eb2-4168-b550-7ec9d2538112 to volume f6c72102-db23-47d7-950f-66b314abab41
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Creating offline snapshot a0e50fa3-1171-4577-a9c9-3d8710a428f2 of volume 55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1394e33f-cce9-4b47-906d-7eb49b6f3d9f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:41 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112
Jul 06 15:44:41 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:42 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112" returned: 0 in 0.758s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:42 devstack sudo[103323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 1G
Jul 06 15:44:42 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:43 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 1G" returned: 0 in 0.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55315cba-1eb2-4168-b550-7ec9d2538112 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:43 devstack sudo[103329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55315cba-1eb2-4168-b550-7ec9d2538112 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2
Jul 06 15:44:43 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:43 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55315cba-1eb2-4168-b550-7ec9d2538112 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2" returned: 0 in 0.677s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:43 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 is being set with open permissions: ugo+rw
Jul 06 15:44:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:43 devstack sudo[103334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2
Jul 06 15:44:43 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:44 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2" returned: 0 in 0.653s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:44 devstack sudo[103338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.info
Jul 06 15:44:44 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:45 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.info" returned: 0 in 0.693s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:45 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.info is being set with open permissions: ugo+rw
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:45 devstack sudo[103341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.info
Jul 06 15:44:45 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:45 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.info" returned: 0 in 0.630s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-quobyte-f6c72102-db23-47d7-950f-66b314abab41" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-f6c72102-db23-47d7-950f-66b314abab41" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] snapshot: a0e50fa3-1171-4577-a9c9-3d8710a428f2, volume: f6c72102-db23-47d7-950f-66b314abab41,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fd157f-d595-470c-bc77-00ccb4dc0362]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:45 devstack sudo[103344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2
Jul 06 15:44:45 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:46 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2" returned: 0 in 0.715s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55315cba-1eb2-4168-b550-7ec9d2538112(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:44:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:44:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:44:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6b066c-50de-4307-8e7d-97f5e56ec9b0]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:46 devstack sudo[103349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112
Jul 06 15:44:46 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:47 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112" returned: 0 in 0.714s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:47 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41 not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:44:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:47 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41
Jul 06 15:44:47 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:51 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41" returned: 0 in 4.025s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:51 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f54d717-76b4-4fe3-a682-29ea333c9be5]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:51 devstack sudo[103367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112
Jul 06 15:44:51 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:52 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112" returned: 0 in 0.886s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:44:52 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Converted 1024.00 MB image at 254.31 MB/s
Jul 06 15:44:52 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41 is being set with open permissions: ugo+rw
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:52 devstack sudo[103372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41
Jul 06 15:44:52 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:52 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41" returned: 0 in 0.606s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-f6c72102-db23-47d7-950f-66b314abab41" released by "_copy_volume_from_snapshot" :: held 7.020s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-quobyte-a0e50fa3-1171-4577-a9c9-3d8710a428f2" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-a0e50fa3-1171-4577-a9c9-3d8710a428f2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Deleting offline snapshot a0e50fa3-1171-4577-a9c9-3d8710a428f2 of volume 55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] snapshot_file for this snap is: volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[113267d5-605c-4f24-b861-d34c52009d49]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:53 devstack sudo[103375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2
Jul 06 15:44:53 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:53 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2" returned: 0 in 0.708s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55315cba-1eb2-4168-b550-7ec9d2538112(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:44:53 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c613a0-e3bb-4fe9-82f6-db316b8c1d53]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:53 devstack sudo[103381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112
Jul 06 15:44:53 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:54 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112" returned: 0 in 0.704s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:54 devstack sudo[103386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2
Jul 06 15:44:54 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:54 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=45,cinder:UPDATE=70,cinder:INSERT=9,cinder:DELETE=6 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:44:55 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2" returned: 0 in 0.701s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:55 devstack sudo[103391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2
Jul 06 15:44:55 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:55 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112.a0e50fa3-1171-4577-a9c9-3d8710a428f2" returned: 0 in 0.609s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-a0e50fa3-1171-4577-a9c9-3d8710a428f2" released by "_delete_snapshot" :: held 2.807s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:44:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.227s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55f9e11-bd76-43bd-997b-1024e86fabba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c72102-db23-47d7-950f-66b314abab41', 'volume_size': 1, 'source_volid': '55315cba-1eb2-4168-b550-7ec9d2538112', 'source_volstatus': 'available'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a70f1ff-f0bf-4999-b2e2-bd51931edcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:55 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Volume volume-f6c72102-db23-47d7-950f-66b314abab41 (f6c72102-db23-47d7-950f-66b314abab41): created successfully
Jul 06 15:44:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a70f1ff-f0bf-4999-b2e2-bd51931edcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (f5b4c0be-d1bf-4f6d-951a-628bb80eb21d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-415c3f74-22fa-4398-9b6c-709b33015be7 tempest-VolumesGetTest-41872445 None] Created volume successfully.
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (d6cb1aa0-b610-4f49-be6a-127be47892cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07eb1211-854d-4fb9-b6d7-b94b0ebc3aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07eb1211-854d-4fb9-b6d7-b94b0ebc3aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:44:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1166082921',display_name='tempest-VolumesGetTest-Volume-886655582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2349ddb8-fcec-4dba-82f6-841ab0e432f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:57Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48ef7d6-80dd-4e4f-89cf-efde3b497c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48ef7d6-80dd-4e4f-89cf-efde3b497c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d9f3bf-4909-4482-baa0-959d633bebba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d9f3bf-4909-4482-baa0-959d633bebba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2349ddb8-fcec-4dba-82f6-841ab0e432f7', 'volume_name': 'volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aef3a90-594a-47df-852d-7d34bea90f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aef3a90-594a-47df-852d-7d34bea90f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5ff896-1365-4f26-a709-e6e654f35fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:57 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Volume 2349ddb8-fcec-4dba-82f6-841ab0e432f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7', 'volume_size': 1}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:44:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1166082921',display_name='tempest-VolumesGetTest-Volume-886655582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2349ddb8-fcec-4dba-82f6-841ab0e432f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:57Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Creating volume 2349ddb8-fcec-4dba-82f6-841ab0e432f7 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:44:57 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:57 devstack sudo[103394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7 1073741824
Jul 06 15:44:57 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:57 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7 1073741824" returned: 0 in 0.786s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:57 devstack sudo[103399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7
Jul 06 15:44:57 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:58 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7" returned: 0 in 0.608s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:44:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:44:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5ff896-1365-4f26-a709-e6e654f35fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cdc072-a59f-4032-9ec1-b04a49025701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:44:58 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Volume volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7 (2349ddb8-fcec-4dba-82f6-841ab0e432f7): created successfully
Jul 06 15:44:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cdc072-a59f-4032-9ec1-b04a49025701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:44:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (d6cb1aa0-b610-4f49-be6a-127be47892cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:44:58 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4e3279da-3ce7-42f8-9cdc-4c5c3e407c7a tempest-VolumesGetTest-41872445 None] Created volume successfully.
Jul 06 15:44:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-2349ddb8-fcec-4dba-82f6-841ab0e432f7-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Lock "cinder-2349ddb8-fcec-4dba-82f6-841ab0e432f7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-quobyte-2349ddb8-fcec-4dba-82f6-841ab0e432f7" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:44:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-2349ddb8-fcec-4dba-82f6-841ab0e432f7" acquired by "delete_volume" :: waited 0.012s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:44:59 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[041d4e7d-04da-4f6f-bbfc-c4377937a133]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:44:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:44:59 devstack sudo[103402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7
Jul 06 15:44:59 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:44:59 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root
Jul 06 15:44:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7" returned: 0 in 0.700s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:44:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:00 devstack sudo[103407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7
Jul 06 15:45:00 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:00 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2349ddb8-fcec-4dba-82f6-841ab0e432f7" returned: 0 in 0.618s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-2349ddb8-fcec-4dba-82f6-841ab0e432f7" released by "delete_volume" :: held 1.356s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:00 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Created reservations ['f0c095e5-b65b-455f-96fe-835cef9383dc', 'b9c813c7-ba16-4dc7-881b-1a8b12a1d6a4', 'b6e3f376-8308-4946-a00c-f4e92564ec0d', '57ba3472-67b8-4574-9484-fcc73d1a9e6e'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:45:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:45:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:45:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:00 devstack sudo[103411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:45:00 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:01 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.606s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:01 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:45:01 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Deleted volume successfully.
Jul 06 15:45:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8d526515-20d4-4867-ab01-b844b9ed96a0 tempest-VolumesGetTest-41872445 None] Lock "cinder-2349ddb8-fcec-4dba-82f6-841ab0e432f7-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-f6c72102-db23-47d7-950f-66b314abab41-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:45:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Lock "cinder-f6c72102-db23-47d7-950f-66b314abab41-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:45:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-quobyte-f6c72102-db23-47d7-950f-66b314abab41" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:45:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-f6c72102-db23-47d7-950f-66b314abab41" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:45:01 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de9f287-5204-411a-9233-9aec35a203a9]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:45:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:01 devstack sudo[103414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41
Jul 06 15:45:01 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:02 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41" returned: 0 in 0.733s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:02 devstack sudo[103422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41
Jul 06 15:45:02 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:02 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f6c72102-db23-47d7-950f-66b314abab41" returned: 0 in 0.637s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-f6c72102-db23-47d7-950f-66b314abab41" released by "delete_volume" :: held 1.405s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:02 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=65,cinder:UPDATE=71,cinder:DELETE=7,cinder:INSERT=25 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:45:02 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Created reservations ['33da978f-849c-4a65-a70a-6253bc34b7d9', 'ee8c0d76-bdba-496a-bf4f-e949401664bb', '1b282ef3-ab7b-432a-a236-27d89ea2ae4b', 'c96b6eb0-4017-4f5e-8bfe-a27b415296fe'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:03 devstack sudo[103425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:45:03 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:03 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.632s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:45:03 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Deleted volume successfully.
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-df94b1ed-34b9-48a3-98c5-ef43dcd4ae65 tempest-VolumesGetTest-41872445 None] Lock "cinder-f6c72102-db23-47d7-950f-66b314abab41-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-55315cba-1eb2-4168-b550-7ec9d2538112-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Lock "cinder-55315cba-1eb2-4168-b550-7ec9d2538112-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-quobyte-55315cba-1eb2-4168-b550-7ec9d2538112" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-55315cba-1eb2-4168-b550-7ec9d2538112" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdddb733-7423-4552-b654-008d72b20c97]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:45:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:03 devstack sudo[103428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112
Jul 06 15:45:03 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:04 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112" returned: 0 in 0.733s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:04 devstack sudo[103433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112
Jul 06 15:45:04 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:05 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-55315cba-1eb2-4168-b550-7ec9d2538112" returned: 0 in 0.627s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-55315cba-1eb2-4168-b550-7ec9d2538112" released by "delete_volume" :: held 1.413s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Created reservations ['9d4dd4dd-ab0b-4e8f-b6e0-850de2859a97', 'da505be7-f833-4c44-ae5f-cdb7997f1096', 'e3c8f8ec-9ee5-45b1-8683-586ba9fc9a28', 'b3f1bb7f-ea1a-498d-9b50-1466c6bc725c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:05 devstack sudo[103436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:45:05 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:05 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.612s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:45:05 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Deleted volume successfully.
Jul 06 15:45:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f24bef5e-654b-47fe-b81c-cb8219801009 tempest-VolumesGetTest-41872445 None] Lock "cinder-55315cba-1eb2-4168-b550-7ec9d2538112-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (6822610d-3dba-440b-8670-1570000b5b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf950313-d48d-427e-b117-f795cf65bee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf950313-d48d-427e-b117-f795cf65bee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-168055612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7162103c-4754-48c4-90bb-a00013e80746,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:07Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5207c8bc-8105-4e50-ab55-bb36f36b4037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5207c8bc-8105-4e50-ab55-bb36f36b4037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f007ad8f-ef5c-4290-9589-832f2979b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.image.glance [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Creating Keystone auth plugin from conf {{(pid=86249) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:06 devstack sudo[103439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:45:06 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f007ad8f-ef5c-4290-9589-832f2979b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7162103c-4754-48c4-90bb-a00013e80746', 'volume_name': 'volume-7162103c-4754-48c4-90bb-a00013e80746', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c985bdd0>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5623095d-2d03-4cf9-98a8-312e8c43a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5623095d-2d03-4cf9-98a8-312e8c43a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a66680-1af1-4721-81b5-2ed0583dc147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:06 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Volume 7162103c-4754-48c4-90bb-a00013e80746: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7162103c-4754-48c4-90bb-a00013e80746', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c985bdd0>}
Jul 06 15:45:06 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Trying to clone 7162103c-4754-48c4-90bb-a00013e80746 from image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]). {{(pid=86249) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 15:45:07 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 15:45:07 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 15:45:07 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.646s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:45:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:45:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:45:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:45:07 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1d5526-9cb7-40e1-b3d2-b79d3c4ee3d4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:45:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:07 devstack sudo[103444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD
Jul 06 15:45:07 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:08 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD" returned: 0 in 0.681s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Temporary image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 is fetched for user ffea57d8a1b547008e1aa1af2425ab31. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8c8fbc-54a2-47b6-8354-ce6f9fa1e81a]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:08 devstack sudo[103449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD
Jul 06 15:45:08 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:08 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD" returned: 0 in 0.675s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-168055612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7162103c-4754-48c4-90bb-a00013e80746,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:07Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Creating volume 7162103c-4754-48c4-90bb-a00013e80746 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:45:08 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:45:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:08 devstack sudo[103454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 1073741824
Jul 06 15:45:08 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:09 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 1073741824" returned: 0 in 0.757s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:09 devstack sudo[103461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746
Jul 06 15:45:09 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:10 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746" returned: 0 in 0.611s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:45:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:10 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Attempting download of af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 ((None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}])) to volume 7162103c-4754-48c4-90bb-a00013e80746. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 15:45:10 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5829fa92-8ed3-4545-a1db-a201c241f752]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:45:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rpl__mf7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:10 devstack sudo[103465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rpl__mf7
Jul 06 15:45:10 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:10 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rpl__mf7" returned: 0 in 0.687s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rpl__mf7 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:11 devstack sudo[103469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rpl__mf7
Jul 06 15:45:11 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:11 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rpl__mf7" returned: 1 in 0.661s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rpl__mf7' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:45:11 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[db14d3d0-a4a7-4f4d-a5a0-f0fc559fcf9c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:45:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:11 devstack sudo[103473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD
Jul 06 15:45:11 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:12 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD" returned: 0 in 0.670s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:12 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 was qcow2, converting to raw {{(pid=86249) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 15:45:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:12 devstack sudo[103478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746
Jul 06 15:45:12 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:13 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746" returned: 0 in 1.696s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:13 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af15cbaf-f1d7-4cb1-81a0-4eb0588c2807_rfw9yxxadevstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:45:13 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Converted 112.00 MB image at 65.99 MB/s
Jul 06 15:45:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:13 devstack sudo[103488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 1G
Jul 06 15:45:13 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:14 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 1G" returned: 0 in 0.646s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:14 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f0af3c-9cde-4436-b1d7-ad24406b0b36]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:45:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:14 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746
Jul 06 15:45:14 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:15 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746" returned: 0 in 0.712s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:15 devstack sudo[103533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746
Jul 06 15:45:15 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:16 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746" returned: 1 in 0.701s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Downloaded image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 ((None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}])) to volume 7162103c-4754-48c4-90bb-a00013e80746 successfully. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Temporary image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 for user ffea57d8a1b547008e1aa1af2425ab31 is deleted. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Marking volume 7162103c-4754-48c4-90bb-a00013e80746 as bootable. {{(pid=86249) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Copying metadata from image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 to 7162103c-4754-48c4-90bb-a00013e80746. {{(pid=86249) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Creating volume glance metadata for volume 7162103c-4754-48c4-90bb-a00013e80746 backed by image af15cbaf-f1d7-4cb1-81a0-4eb0588c2807 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86249) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a66680-1af1-4721-81b5-2ed0583dc147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7162103c-4754-48c4-90bb-a00013e80746', 'volume_size': 1, 'image_id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4a36605402743a6b31831ae0b630247', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af15cbaf-f1d7-4cb1-81a0-4eb0588c2807', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af15cbaf-f1d7-4cb1-81a0-4eb0588c2807/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c985bdd0>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176c8b05-e0aa-4236-83aa-5cd666df3268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:16 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Volume volume-7162103c-4754-48c4-90bb-a00013e80746 (7162103c-4754-48c4-90bb-a00013e80746): created successfully
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176c8b05-e0aa-4236-83aa-5cd666df3268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (6822610d-3dba-440b-8670-1570000b5b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:45:16 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2405e3ea-827b-4f00-981c-e47fd2ab0f40 tempest-VolumesGetTest-41872445 None] Created volume successfully.
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (872a1ce8-f4a7-4c5a-9734-b06973c62a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a38718-d826-4f7f-a3d0-3482fc0036d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a38718-d826-4f7f-a3d0-3482fc0036d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:45:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2143550389',display_name='tempest-VolumesGetTest-Volume-1863142966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13ba88c-cfb0-4d68-89bc-43d1416f5281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:18Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2384c8ed-b101-4c76-a4bc-d9214d413f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2384c8ed-b101-4c76-a4bc-d9214d413f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8a2dc3-6712-43ba-8cd7-65680791bea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8a2dc3-6712-43ba-8cd7-65680791bea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13ba88c-cfb0-4d68-89bc-43d1416f5281', 'volume_name': 'volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267971f1-ff79-4863-842f-13382ba8750d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267971f1-ff79-4863-842f-13382ba8750d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc071c3-5c76-4ab7-8050-7d4ea2ed0b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:17 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Volume f13ba88c-cfb0-4d68-89bc-43d1416f5281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281', 'volume_size': 1}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:45:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2143550389',display_name='tempest-VolumesGetTest-Volume-1863142966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13ba88c-cfb0-4d68-89bc-43d1416f5281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21448e2b19f34bcf807ab14db0e0aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:18Z,use_quota=True,user_id='ffea57d8a1b547008e1aa1af2425ab31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Creating volume f13ba88c-cfb0-4d68-89bc-43d1416f5281 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:45:17 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:45:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:17 devstack sudo[103538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281 1073741824
Jul 06 15:45:17 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:18 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281 1073741824" returned: 0 in 0.773s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:18 devstack sudo[103544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281
Jul 06 15:45:18 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:19 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281" returned: 0 in 0.591s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:45:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc071c3-5c76-4ab7-8050-7d4ea2ed0b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132d9ecb-3e77-46dc-a23d-1303346f7de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:19 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Volume volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281 (f13ba88c-cfb0-4d68-89bc-43d1416f5281): created successfully
Jul 06 15:45:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132d9ecb-3e77-46dc-a23d-1303346f7de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:19 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Flow 'volume_create_manager' (872a1ce8-f4a7-4c5a-9734-b06973c62a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:45:19 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3af1dd20-af41-4f6a-b7ae-0f7c5987ba1e tempest-VolumesGetTest-41872445 None] Created volume successfully.
Jul 06 15:45:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-f13ba88c-cfb0-4d68-89bc-43d1416f5281-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:45:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Lock "cinder-f13ba88c-cfb0-4d68-89bc-43d1416f5281-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:45:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-quobyte-f13ba88c-cfb0-4d68-89bc-43d1416f5281" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:45:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-f13ba88c-cfb0-4d68-89bc-43d1416f5281" acquired by "delete_volume" :: waited 0.013s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:45:20 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[09df6ed0-d8b8-47fe-b812-18c2171bfbdf]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:45:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:20 devstack sudo[103547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281
Jul 06 15:45:20 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:20 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281" returned: 0 in 0.729s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:20 devstack sudo[103553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281
Jul 06 15:45:20 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:21 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-f13ba88c-cfb0-4d68-89bc-43d1416f5281" returned: 0 in 0.632s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-f13ba88c-cfb0-4d68-89bc-43d1416f5281" released by "delete_volume" :: held 1.399s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:21 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Created reservations ['ab2af296-77e1-46d9-a9f3-fea6ad4ca775', 'a17d4087-fb41-4383-9cd2-f23cecc3eb00', '72a2f0c4-42fc-44a2-b451-14904a1de46b', '0480dbcc-9159-4937-b144-823034a2e5e2'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:45:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:45:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:45:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:21 devstack sudo[103556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:45:21 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:22 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.634s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:22 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:45:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Deleted volume successfully.
Jul 06 15:45:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-bf66c7da-1a4d-49da-8a1b-52f8ef0e2773 tempest-VolumesGetTest-41872445 None] Lock "cinder-f13ba88c-cfb0-4d68-89bc-43d1416f5281-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-7162103c-4754-48c4-90bb-a00013e80746-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:45:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Lock "cinder-7162103c-4754-48c4-90bb-a00013e80746-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:45:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Acquiring lock "cinder-quobyte-7162103c-4754-48c4-90bb-a00013e80746" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:45:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-7162103c-4754-48c4-90bb-a00013e80746" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:45:22 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[95037fd9-671f-4eff-be16-efe1438bf589]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:45:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:22 devstack sudo[103559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746
Jul 06 15:45:22 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:23 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746" returned: 0 in 0.705s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:23 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746
Jul 06 15:45:23 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:23 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746" returned: 1 in 0.713s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:45:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:23 devstack sudo[103568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746
Jul 06 15:45:23 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:24 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7162103c-4754-48c4-90bb-a00013e80746" returned: 0 in 0.629s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:24 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Lock "cinder-quobyte-7162103c-4754-48c4-90bb-a00013e80746" released by "delete_volume" :: held 2.106s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:24 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Created reservations ['38f4365f-5e1c-4a7c-9e0f-2dc21ac8a61e', '68f50e56-b274-4748-9364-3afc64a88339', 'f9c830eb-4795-4ea2-a9b1-1b27855912bb', 'b70e6790-c681-40cb-a30c-1b33a4240d86'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:45:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:45:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:45:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:24 devstack sudo[103577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:45:24 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:25 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.618s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:25 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:45:25 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Deleted volume successfully.
Jul 06 15:45:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-74c9f2e0-177f-4f22-89cc-e121dd781ca0 tempest-VolumesGetTest-41872445 None] Lock "cinder-7162103c-4754-48c4-90bb-a00013e80746-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Flow 'volume_create_manager' (841574e7-d119-4723-aefb-6ec254c6374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49089a89-9df1-4ee9-99f4-116587974814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49089a89-9df1-4ee9-99f4-116587974814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2117719821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748cb765-4a24-4308-aafb-bd848a96f4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d8ef39f28344ca935013d5fef3c102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:28Z,use_quota=True,user_id='da8273e843f0490289a992c31b74f511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02c55dc-c4fa-4124-b97b-b83bddcb833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02c55dc-c4fa-4124-b97b-b83bddcb833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b16413-662d-407b-b8d7-a10d1078c65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b16413-662d-407b-b8d7-a10d1078c65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748cb765-4a24-4308-aafb-bd848a96f4e8', 'volume_name': 'volume-748cb765-4a24-4308-aafb-bd848a96f4e8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1f0dde-d3a4-4bfb-a94d-f7981475f15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1f0dde-d3a4-4bfb-a94d-f7981475f15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6377f8c-c813-408f-b453-d18f6f85cc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:28 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Volume 748cb765-4a24-4308-aafb-bd848a96f4e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748cb765-4a24-4308-aafb-bd848a96f4e8', 'volume_size': 1}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2117719821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748cb765-4a24-4308-aafb-bd848a96f4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d8ef39f28344ca935013d5fef3c102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:28Z,use_quota=True,user_id='da8273e843f0490289a992c31b74f511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Creating volume 748cb765-4a24-4308-aafb-bd848a96f4e8 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:45:28 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:28 devstack sudo[103581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8 1073741824
Jul 06 15:45:28 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:28 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8 1073741824" returned: 0 in 0.764s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:29 devstack sudo[103586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8
Jul 06 15:45:29 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:29 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8" returned: 0 in 0.632s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:45:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6377f8c-c813-408f-b453-d18f6f85cc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748cb765-4a24-4308-aafb-bd848a96f4e8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcc3a7f-111f-44a0-834d-2f646cf7432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:45:29 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Volume volume-748cb765-4a24-4308-aafb-bd848a96f4e8 (748cb765-4a24-4308-aafb-bd848a96f4e8): created successfully
Jul 06 15:45:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcc3a7f-111f-44a0-834d-2f646cf7432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:45:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Flow 'volume_create_manager' (841574e7-d119-4723-aefb-6ec254c6374e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:45:29 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-979be3f8-1630-47af-a89c-1fe43adde2a7 tempest-VolumesNegativeTest-1954359956 None] Created volume successfully.
Jul 06 15:45:43 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=54,cinder:INSERT=20,cinder:SELECT=39,cinder:DELETE=4 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:45:43 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:INSERT=15,cinder:UPDATE=45,cinder:SELECT=35,cinder:DELETE=4 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:45:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Acquiring lock "cinder-748cb765-4a24-4308-aafb-bd848a96f4e8-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:45:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Lock "cinder-748cb765-4a24-4308-aafb-bd848a96f4e8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:45:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Acquiring lock "cinder-quobyte-748cb765-4a24-4308-aafb-bd848a96f4e8" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:45:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Lock "cinder-quobyte-748cb765-4a24-4308-aafb-bd848a96f4e8" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:45:57 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21f8de8-7281-47fe-b936-9a68f7eb9ee2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:45:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:58 devstack sudo[103714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8
Jul 06 15:45:58 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:58 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8" returned: 0 in 0.722s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:58 devstack sudo[103719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8
Jul 06 15:45:58 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:45:59 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root
Jul 06 15:45:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-748cb765-4a24-4308-aafb-bd848a96f4e8" returned: 0 in 0.605s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:45:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Lock "cinder-quobyte-748cb765-4a24-4308-aafb-bd848a96f4e8" released by "delete_volume" :: held 1.367s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:45:59 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Created reservations ['24549475-9019-44f8-aacd-5dba524ad819', '4b08f80c-9a68-4c09-bbe9-1ec201900541', '49824779-8005-4592-9de5-9376371cf8ea', '7e971684-704f-44cc-a5ba-b492ea90d889'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:45:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:45:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:45:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:45:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:45:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:45:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:45:59 devstack sudo[103722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:45:59 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:00 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.633s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:00 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:46:00 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Deleted volume successfully.
Jul 06 15:46:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed140d09-4548-4ff6-997e-6fa2e0a103b7 tempest-VolumesNegativeTest-1954359956 None] Lock "cinder-748cb765-4a24-4308-aafb-bd848a96f4e8-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Flow 'volume_create_manager' (f47b9418-c9da-4823-99f9-3021587e78aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfa4b1a-a83b-4366-bba8-4fab4ab1eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfa4b1a-a83b-4366-bba8-4fab4ab1eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f20a107-8b62-43f3-9dbc-8c6e1fed2022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7cf3e5169b4b93ad1bc7847039970f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:05Z,use_quota=True,user_id='6db31cd79e854a2095a3572fb62b5d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72696746-c0e8-43a8-8fe5-384cf14656e1),volume_type_id=72696746-c0e8-43a8-8fe5-384cf14656e1)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af160a86-adcd-45fd-a459-c24b92a35f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af160a86-adcd-45fd-a459-c24b92a35f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f278ba8-0b02-4cd7-91c3-5bfaafb0416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.image.glance [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Creating Keystone auth plugin from conf {{(pid=86249) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f278ba8-0b02-4cd7-91c3-5bfaafb0416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f20a107-8b62-43f3-9dbc-8c6e1fed2022', 'volume_name': 'volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022', 'volume_size': 1, 'image_id': 'aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2f145012714b7ea6fdd5854fb7e55ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c7cf3e5169b4b93ad1bc7847039970f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '408038b19ed6549556df38b07f6461507cd56f8669bc58e996dfdcf14b6838069e4848f907339bc38f42f9350a22a88355cecaeac5ce065f5a81e60ffadbc6d7', 'id': 'aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2bec242c0>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e581f982-05f8-4a66-843d-cdbc5e0683de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e581f982-05f8-4a66-843d-cdbc5e0683de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb66f8a7-0e53-482e-8cb1-e7f41a1e1daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:05 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Volume 1f20a107-8b62-43f3-9dbc-8c6e1fed2022: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022', 'volume_size': 1, 'image_id': 'aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2f145012714b7ea6fdd5854fb7e55ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c7cf3e5169b4b93ad1bc7847039970f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '408038b19ed6549556df38b07f6461507cd56f8669bc58e996dfdcf14b6838069e4848f907339bc38f42f9350a22a88355cecaeac5ce065f5a81e60ffadbc6d7', 'id': 'aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2bec242c0>}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Trying to clone 1f20a107-8b62-43f3-9dbc-8c6e1fed2022 from image aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'metadata': {}}]). {{(pid=86249) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 15:46:05 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[7984fb0a-1cad-41b1-ac42-0569209af3f0]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:05 devstack sudo[103726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD
Jul 06 15:46:05 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:06 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD" returned: 0 in 0.688s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:06 devstack sudo[103730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD
Jul 06 15:46:06 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:46:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:06 devstack sudo[103732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:46:06 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:07 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD" returned: 1 in 0.706s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Temporary image aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd is fetched for user 6db31cd79e854a2095a3572fb62b5d5f. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1198303-dad1-4454-b9ef-387710f3a4e1]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:07 devstack sudo[103738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD
Jul 06 15:46:07 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:07 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.638s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:46:07 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:07 devstack sudo[103743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD
Jul 06 15:46:07 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:08 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD" returned: 1 in 0.674s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f20a107-8b62-43f3-9dbc-8c6e1fed2022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7cf3e5169b4b93ad1bc7847039970f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:05Z,use_quota=True,user_id='6db31cd79e854a2095a3572fb62b5d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72696746-c0e8-43a8-8fe5-384cf14656e1),volume_type_id=72696746-c0e8-43a8-8fe5-384cf14656e1)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Creating volume 1f20a107-8b62-43f3-9dbc-8c6e1fed2022 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:08 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:08 devstack sudo[103748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 1073741824
Jul 06 15:46:08 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:09 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 1073741824" returned: 0 in 0.757s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:09 devstack sudo[103754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022
Jul 06 15:46:09 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:09 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022" returned: 0 in 0.619s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:10 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Attempting download of aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd ((None, [{'url': 'file:///opt/stack/data/glance/images/aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'metadata': {}}])) to volume 1f20a107-8b62-43f3-9dbc-8c6e1fed2022. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 15:46:10 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88b8944-d69c-46b0-8ee3-5f6bb2b47370]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd__1zr98sy {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:10 devstack sudo[103759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd__1zr98sy
Jul 06 15:46:10 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:10 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd__1zr98sy" returned: 0 in 0.685s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd__1zr98sy {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:10 devstack sudo[103764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd__1zr98sy
Jul 06 15:46:10 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:11 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd__1zr98sy" returned: 1 in 0.683s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd__1zr98sy' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:11 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fadcd4a-ccaa-4ea0-847a-cccfc54c8741]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:11 devstack sudo[103768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD
Jul 06 15:46:11 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:12 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD" returned: 0 in 0.709s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:12 devstack sudo[103772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD
Jul 06 15:46:12 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:12 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD" returned: 1 in 0.710s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:12 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd was raw, converting to raw {{(pid=86249) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 15:46:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:12 devstack sudo[103777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022
Jul 06 15:46:12 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:13 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022" returned: 0 in 0.695s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:13 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd_btum4mabdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:46:13 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 15:46:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:13 devstack sudo[103782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 1G
Jul 06 15:46:13 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:14 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 1G" returned: 0 in 0.641s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:14 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f693bce-f770-4a15-9569-6b597eb2282f]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:14 devstack sudo[103787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022
Jul 06 15:46:14 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:14 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022" returned: 0 in 0.710s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:15 devstack sudo[103791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022
Jul 06 15:46:15 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:15 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022" returned: 1 in 0.750s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Downloaded image aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd ((None, [{'url': 'file:///opt/stack/data/glance/images/aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'metadata': {}}])) to volume 1f20a107-8b62-43f3-9dbc-8c6e1fed2022 successfully. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Temporary image aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd for user 6db31cd79e854a2095a3572fb62b5d5f is deleted. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Marking volume 1f20a107-8b62-43f3-9dbc-8c6e1fed2022 as bootable. {{(pid=86249) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Copying metadata from image aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd to 1f20a107-8b62-43f3-9dbc-8c6e1fed2022. {{(pid=86249) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Creating volume glance metadata for volume 1f20a107-8b62-43f3-9dbc-8c6e1fed2022 backed by image aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e2f145012714b7ea6fdd5854fb7e55ee', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86249) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb66f8a7-0e53-482e-8cb1-e7f41a1e1daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022', 'volume_size': 1, 'image_id': 'aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2f145012714b7ea6fdd5854fb7e55ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c7cf3e5169b4b93ad1bc7847039970f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '408038b19ed6549556df38b07f6461507cd56f8669bc58e996dfdcf14b6838069e4848f907339bc38f42f9350a22a88355cecaeac5ce065f5a81e60ffadbc6d7', 'id': 'aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa709e1a-7b0b-4f3d-9dfe-9e75e7fdefbd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2bec242c0>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07be78f9-3c10-47d5-b8b7-81c48a4d884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:15 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Volume volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 (1f20a107-8b62-43f3-9dbc-8c6e1fed2022): created successfully
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07be78f9-3c10-47d5-b8b7-81c48a4d884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:15 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Flow 'volume_create_manager' (f47b9418-c9da-4823-99f9-3021587e78aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9f356434-895c-4f6a-a264-ba4e1950df60 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Created volume successfully.
Jul 06 15:46:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Acquiring lock "cinder-1f20a107-8b62-43f3-9dbc-8c6e1fed2022-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Lock "cinder-1f20a107-8b62-43f3-9dbc-8c6e1fed2022-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Acquiring lock "cinder-quobyte-1f20a107-8b62-43f3-9dbc-8c6e1fed2022" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Lock "cinder-quobyte-1f20a107-8b62-43f3-9dbc-8c6e1fed2022" acquired by "delete_volume" :: waited 0.012s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:17 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c040e7f2-2949-4006-a02f-c76bed08cc8f]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:17 devstack sudo[103832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022
Jul 06 15:46:17 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:17 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022" returned: 0 in 0.703s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:17 devstack sudo[103836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022
Jul 06 15:46:17 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:18 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022" returned: 1 in 0.723s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:18 devstack sudo[103841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022
Jul 06 15:46:18 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:19 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1f20a107-8b62-43f3-9dbc-8c6e1fed2022" returned: 0 in 0.603s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Lock "cinder-quobyte-1f20a107-8b62-43f3-9dbc-8c6e1fed2022" released by "delete_volume" :: held 2.093s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:19 devstack cinder-volume[86249]: WARNING cinder.quota [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:46:19 devstack cinder-volume[86249]: WARNING cinder.quota [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Created reservations ['d93cec90-cce0-4e0f-9601-1aec80b49666', '133780cf-c59a-45b3-80be-91f8060e3801', '63034790-502b-43b9-a503-7a02c357a71c', 'a1f57d42-3608-4ed8-8527-05167e06309b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:19 devstack sudo[103844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:46:19 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:19 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.590s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:46:19 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Deleted volume successfully.
Jul 06 15:46:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e84c214-a257-4c5b-8759-367c1f6caed6 tempest-VolumeAndVolumeTypeFromImageTest-1069294910 None] Lock "cinder-1f20a107-8b62-43f3-9dbc-8c6e1fed2022-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:29 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=22,cinder:SELECT=17,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:46:29 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=19,cinder:INSERT=10,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:46:32 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Flow 'volume_create_manager' (b7188d9d-19db-47b1-abf5-36e7254ca2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6adecd7-6c30-4c99-9092-ac5991e87730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6adecd7-6c30-4c99-9092-ac5991e87730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-235328933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4137d6b5-0776-47c9-be38-3aea4ad11a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fb58fc787b48109f1d3ba3c38c0f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:33Z,use_quota=True,user_id='cac233f26e694cd79380d0f20590fba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3f54e6-9ee9-4773-b1a9-ddd42ff7bd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3f54e6-9ee9-4773-b1a9-ddd42ff7bd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4527d22-3968-4b6c-a510-fe786624d46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4527d22-3968-4b6c-a510-fe786624d46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4137d6b5-0776-47c9-be38-3aea4ad11a1f', 'volume_name': 'volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a7f512-132a-417e-8908-bc2922b4d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a7f512-132a-417e-8908-bc2922b4d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff3c9e7-c435-4f66-b53f-08a22a650aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:33 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Volume 4137d6b5-0776-47c9-be38-3aea4ad11a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f', 'volume_size': 1}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-235328933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4137d6b5-0776-47c9-be38-3aea4ad11a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fb58fc787b48109f1d3ba3c38c0f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:33Z,use_quota=True,user_id='cac233f26e694cd79380d0f20590fba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Creating volume 4137d6b5-0776-47c9-be38-3aea4ad11a1f {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:33 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:33 devstack sudo[103891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f 1073741824
Jul 06 15:46:33 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (1c72dbdd-18bc-4e24-bf24-4bf67e96cf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c398fd-9e0e-48aa-a8f1-af4057afd02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c398fd-9e0e-48aa-a8f1-af4057afd02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1192918948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2d9399-b634-4ea2-bcef-e03d8ca4666c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:33Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93093019-3399-49a3-906f-8f150030be75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93093019-3399-49a3-906f-8f150030be75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58f5d3c-9e65-4cfd-b5a8-aa0fcabfffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58f5d3c-9e65-4cfd-b5a8-aa0fcabfffaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2d9399-b634-4ea2-bcef-e03d8ca4666c', 'volume_name': 'volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6481be7b-5033-41d2-ad4c-9f90df15d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6481be7b-5033-41d2-ad4c-9f90df15d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0a58a1-cfc7-4926-b6ac-d6b6cc86464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:33 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume fb2d9399-b634-4ea2-bcef-e03d8ca4666c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c', 'volume_size': 1}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Flow 'volume_create_manager' (d3a8876f-ded0-47ec-9195-996c6deeff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bff0b1a-8ad7-4246-824e-83778c376a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bff0b1a-8ad7-4246-824e-83778c376a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-276529313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d3efaf-56a9-4028-b1b1-11ebfe354a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fb58fc787b48109f1d3ba3c38c0f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:34Z,use_quota=True,user_id='cac233f26e694cd79380d0f20590fba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f66ca5-340d-4126-849f-7621e32dc3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f66ca5-340d-4126-849f-7621e32dc3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3673c83-2438-44c0-b4fc-c60f552f81ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3673c83-2438-44c0-b4fc-c60f552f81ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d3efaf-56a9-4028-b1b1-11ebfe354a00', 'volume_name': 'volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48a368d-b9d4-4d80-a0e6-3d2cdae96901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48a368d-b9d4-4d80-a0e6-3d2cdae96901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30b5ad2-2a6b-433b-a104-894e2f1a95f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Volume 18d3efaf-56a9-4028-b1b1-11ebfe354a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00', 'volume_size': 1}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (8b08de14-2775-4578-a16a-4c2932370fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5fdd76c-fe3e-4ca4-a09e-ce07a43150d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5fdd76c-fe3e-4ca4-a09e-ce07a43150d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-529348710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f96517-1d63-40d6-a3a9-40f39fce1a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:34Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694be68c-788f-4008-ae75-cce46e8f6125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694be68c-788f-4008-ae75-cce46e8f6125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c03755b-8b98-4945-8393-2a4b0dd174d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c03755b-8b98-4945-8393-2a4b0dd174d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f96517-1d63-40d6-a3a9-40f39fce1a46', 'volume_name': 'volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86ed190-af55-4c25-ba08-2181102c1df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86ed190-af55-4c25-ba08-2181102c1df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f580d3-b065-4763-9094-433afe91fc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume a7f96517-1d63-40d6-a3a9-40f39fce1a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46', 'volume_size': 1}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Flow 'volume_create_manager' (39e0f1b3-54ba-4841-ad0e-1640fc31fd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad71f17-6eb0-4660-9c0b-d310de96e5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad71f17-6eb0-4660-9c0b-d310de96e5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2038127770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b8dc43-97e9-4369-81e3-fba4fb361d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fb58fc787b48109f1d3ba3c38c0f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:34Z,use_quota=True,user_id='cac233f26e694cd79380d0f20590fba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11b91a4-3c15-4731-91d0-65dd9cc9f0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11b91a4-3c15-4731-91d0-65dd9cc9f0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e93167-be53-4f9b-a97b-cf1231cd2559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e93167-be53-4f9b-a97b-cf1231cd2559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b8dc43-97e9-4369-81e3-fba4fb361d5c', 'volume_name': 'volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed50178-380f-4a94-8342-a86510b77928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed50178-380f-4a94-8342-a86510b77928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b79664-a7e6-41a8-8e54-e98c0e22cfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Volume d0b8dc43-97e9-4369-81e3-fba4fb361d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c', 'volume_size': 1}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:34 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f 1073741824" returned: 0 in 1.312s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:34 devstack sudo[103899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f
Jul 06 15:46:34 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Flow 'volume_create_manager' (8995d4b8-3174-4955-bf0e-c55fe6bd6064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10a9a3d-3c27-4b74-94fe-6fc18631571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10a9a3d-3c27-4b74-94fe-6fc18631571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-262739206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e45b1a-092c-4586-9084-bd8968207c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fb58fc787b48109f1d3ba3c38c0f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:35Z,use_quota=True,user_id='cac233f26e694cd79380d0f20590fba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10538258-58d3-4854-ac44-166cb5eb3d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10538258-58d3-4854-ac44-166cb5eb3d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ccdfc0-1981-45c0-b058-8ecda06eeff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ccdfc0-1981-45c0-b058-8ecda06eeff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e45b1a-092c-4586-9084-bd8968207c91', 'volume_name': 'volume-08e45b1a-092c-4586-9084-bd8968207c91', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4835c584-0747-4f9b-9d41-e7bf6d307cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4835c584-0747-4f9b-9d41-e7bf6d307cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4744d93-4f36-4306-bbea-5b6f4e8adcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:34 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Volume 08e45b1a-092c-4586-9084-bd8968207c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e45b1a-092c-4586-9084-bd8968207c91', 'volume_size': 1}
Jul 06 15:46:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Flow 'volume_create_manager' (661abbb3-37eb-43a3-9d84-af8c7bdcf636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504e5c48-4ffa-4c06-9354-5660d123ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504e5c48-4ffa-4c06-9354-5660d123ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018228302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade86224-2dcb-4c74-8ad5-d90b742c926b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fb58fc787b48109f1d3ba3c38c0f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:35Z,use_quota=True,user_id='cac233f26e694cd79380d0f20590fba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b6d589-06ad-45a2-a4cf-8f377878b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b6d589-06ad-45a2-a4cf-8f377878b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d751ad9-ede9-475f-a229-1b07c7af061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d751ad9-ede9-475f-a229-1b07c7af061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade86224-2dcb-4c74-8ad5-d90b742c926b', 'volume_name': 'volume-ade86224-2dcb-4c74-8ad5-d90b742c926b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8025907e-785b-4176-82b8-b97f57f0cc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8025907e-785b-4176-82b8-b97f57f0cc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a43be01-c701-40e7-ac02-d6d6ccfbaa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:35 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Volume ade86224-2dcb-4c74-8ad5-d90b742c926b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade86224-2dcb-4c74-8ad5-d90b742c926b', 'volume_size': 1}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:35 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f" returned: 0 in 0.770s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1192918948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2d9399-b634-4ea2-bcef-e03d8ca4666c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:33Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Creating volume fb2d9399-b634-4ea2-bcef-e03d8ca4666c {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:35 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff3c9e7-c435-4f66-b53f-08a22a650aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:35 devstack sudo[103902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c 1073741824
Jul 06 15:46:35 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848de2be-99e1-436a-8086-2d55897dea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:35 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Volume volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f (4137d6b5-0776-47c9-be38-3aea4ad11a1f): created successfully
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848de2be-99e1-436a-8086-2d55897dea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Flow 'volume_create_manager' (b7188d9d-19db-47b1-abf5-36e7254ca2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:35 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7452d63a-4f76-4c0c-91d1-5b0ae6e50ba4 tempest-CreateVolumesFromImageTest-1096556451 None] Created volume successfully.
Jul 06 15:46:36 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c 1073741824" returned: 0 in 0.847s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:36 devstack sudo[103908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c
Jul 06 15:46:36 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:36 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" returned: 0 in 0.628s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.715s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-276529313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d3efaf-56a9-4028-b1b1-11ebfe354a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fb58fc787b48109f1d3ba3c38c0f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:34Z,use_quota=True,user_id='cac233f26e694cd79380d0f20590fba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Creating volume 18d3efaf-56a9-4028-b1b1-11ebfe354a00 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:36 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:36 devstack sudo[103911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00 1073741824
Jul 06 15:46:36 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0a58a1-cfc7-4926-b6ac-d6b6cc86464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae19175-9750-479f-b275-a9cc1a3cb7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:36 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c (fb2d9399-b634-4ea2-bcef-e03d8ca4666c): created successfully
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae19175-9750-479f-b275-a9cc1a3cb7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (1c72dbdd-18bc-4e24-bf24-4bf67e96cf54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6961a677-e166-4496-9c14-e72e0e78f0c7 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created volume successfully.
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Flow 'volume_create_manager' (6e16a845-385c-437a-9724-1295bf20517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d243d556-3a03-4ea6-a84f-dcb7d5711521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d243d556-3a03-4ea6-a84f-dcb7d5711521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916005bd-90ec-4b16-bdea-fa85922de70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303ef950e20b4dc7915d7de3ef53cce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:37Z,use_quota=True,user_id='a828488b7eb14dee9e1efc7817289043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffd0c02c-b5e2-4c77-b444-85ea9b0af939),volume_type_id=ffd0c02c-b5e2-4c77-b444-85ea9b0af939)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107f6c4d-1f20-4ebb-812b-f0da82f2edc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107f6c4d-1f20-4ebb-812b-f0da82f2edc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d66106b-a41a-4cd2-a7a5-c35979bdbe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.image.glance [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Creating Keystone auth plugin from conf {{(pid=86249) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d66106b-a41a-4cd2-a7a5-c35979bdbe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '916005bd-90ec-4b16-bdea-fa85922de70e', 'volume_name': 'volume-916005bd-90ec-4b16-bdea-fa85922de70e', 'volume_size': 1, 'image_id': '31e87e4d-564b-4313-88dd-e3fca2d6e155', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31e87e4d-564b-4313-88dd-e3fca2d6e155', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f09f5d9dbcc575848591d276043f8d61', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '303ef950e20b4dc7915d7de3ef53cce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed056f08304c976bea373b2b69a20405e215ccb522cc996c2875a3dccfe1f157397b1fc6ce561121ab66e7b03b873eb35d034961c14e5711c7c61b6f22b6520f', 'id': '31e87e4d-564b-4313-88dd-e3fca2d6e155', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31e87e4d-564b-4313-88dd-e3fca2d6e155/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c909c050>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02951c7-cfce-4ac4-bb0d-d6defac8da25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02951c7-cfce-4ac4-bb0d-d6defac8da25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c38bf0-24d2-4bb5-8f27-41f60ffa8ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:37 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Volume 916005bd-90ec-4b16-bdea-fa85922de70e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-916005bd-90ec-4b16-bdea-fa85922de70e', 'volume_size': 1, 'image_id': '31e87e4d-564b-4313-88dd-e3fca2d6e155', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31e87e4d-564b-4313-88dd-e3fca2d6e155', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f09f5d9dbcc575848591d276043f8d61', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '303ef950e20b4dc7915d7de3ef53cce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed056f08304c976bea373b2b69a20405e215ccb522cc996c2875a3dccfe1f157397b1fc6ce561121ab66e7b03b873eb35d034961c14e5711c7c61b6f22b6520f', 'id': '31e87e4d-564b-4313-88dd-e3fca2d6e155', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31e87e4d-564b-4313-88dd-e3fca2d6e155/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c909c050>}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Trying to clone 916005bd-90ec-4b16-bdea-fa85922de70e from image 31e87e4d-564b-4313-88dd-e3fca2d6e155 at location (None, [{'url': 'file:///opt/stack/data/glance/images/31e87e4d-564b-4313-88dd-e3fca2d6e155', 'metadata': {}}]). {{(pid=86249) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 15:46:37 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0470e03-7116-440f-abab-f0bce7aaa778]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:37 devstack sudo[103917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD
Jul 06 15:46:37 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:37 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00 1073741824" returned: 0 in 0.909s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:37 devstack sudo[103919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00
Jul 06 15:46:37 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:38 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:38 devstack sudo[103923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD
Jul 06 15:46:38 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:38 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00" returned: 0 in 0.741s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.231s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-529348710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f96517-1d63-40d6-a3a9-40f39fce1a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:34Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Creating volume a7f96517-1d63-40d6-a3a9-40f39fce1a46 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:38 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:38 devstack sudo[103926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46 1073741824
Jul 06 15:46:38 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30b5ad2-2a6b-433b-a104-894e2f1a95f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6ec2bb-1cff-4785-8ab0-d0293463d294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:38 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Volume volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00 (18d3efaf-56a9-4028-b1b1-11ebfe354a00): created successfully
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6ec2bb-1cff-4785-8ab0-d0293463d294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Flow 'volume_create_manager' (d3a8876f-ded0-47ec-9195-996c6deeff84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-26929ff3-ba51-427a-8bbc-23be522d8a3d tempest-CreateVolumesFromImageTest-1096556451 None] Created volume successfully.
Jul 06 15:46:39 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD" returned: 1 in 0.769s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:39 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Temporary image 31e87e4d-564b-4313-88dd-e3fca2d6e155 is fetched for user a828488b7eb14dee9e1efc7817289043. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 15:46:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b901177-6e03-44e0-ae53-6a5b9603de32]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:39 devstack sudo[103934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD
Jul 06 15:46:39 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:39 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46 1073741824" returned: 0 in 0.861s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:39 devstack sudo[103937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46
Jul 06 15:46:39 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:39 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD" returned: 0 in 0.796s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:40 devstack sudo[103941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD
Jul 06 15:46:40 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:40 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46" returned: 0 in 0.619s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.643s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2038127770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b8dc43-97e9-4369-81e3-fba4fb361d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fb58fc787b48109f1d3ba3c38c0f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:34Z,use_quota=True,user_id='cac233f26e694cd79380d0f20590fba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Creating volume d0b8dc43-97e9-4369-81e3-fba4fb361d5c {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:40 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:40 devstack sudo[103944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c 1073741824
Jul 06 15:46:40 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f580d3-b065-4763-9094-433afe91fc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa604ce-5a74-426f-b764-8ebb1368dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:40 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46 (a7f96517-1d63-40d6-a3a9-40f39fce1a46): created successfully
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa604ce-5a74-426f-b764-8ebb1368dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (8b08de14-2775-4578-a16a-4c2932370fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:40 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7eaccd0f-6fe0-4a54-b26e-37e5d0f33567 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created volume successfully.
Jul 06 15:46:40 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD" returned: 1 in 0.856s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (07d42000-89ba-4480-bcd0-8fdcfa6d792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d806e1d3-f824-4a7b-b3ea-97ec8621e01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d806e1d3-f824-4a7b-b3ea-97ec8621e01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717381465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4536b5-a358-45bd-833d-8ac00806400a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:41Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fea045-488b-4de2-b38a-510cb0f6d87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fea045-488b-4de2-b38a-510cb0f6d87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca3bd9e-e37d-4a1a-bd33-6898f22b40ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca3bd9e-e37d-4a1a-bd33-6898f22b40ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb4536b5-a358-45bd-833d-8ac00806400a', 'volume_name': 'volume-eb4536b5-a358-45bd-833d-8ac00806400a', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:40 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496d3492-4758-4401-9392-8d22018aaa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496d3492-4758-4401-9392-8d22018aaa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8120a0a-ce82-4eea-bf80-af2a172fe839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:40 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume eb4536b5-a358-45bd-833d-8ac00806400a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb4536b5-a358-45bd-833d-8ac00806400a', 'volume_size': 1}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c 1073741824" returned: 0 in 0.903s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:41 devstack sudo[103954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c
Jul 06 15:46:41 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (da2a58e8-cf91-4dd0-b89a-fef04ff86db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44c48fc-d5a3-4fb7-a3a2-cdc8a9322b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44c48fc-d5a3-4fb7-a3a2-cdc8a9322b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-919092884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48973eab-17d3-4b2b-9c47-af0b8a46b305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:41Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578f29a8-19ab-4fd6-8e45-92435f46b960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578f29a8-19ab-4fd6-8e45-92435f46b960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99bff7a-be44-40bb-94b5-0085da176fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99bff7a-be44-40bb-94b5-0085da176fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48973eab-17d3-4b2b-9c47-af0b8a46b305', 'volume_name': 'volume-48973eab-17d3-4b2b-9c47-af0b8a46b305', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6854f0-17d1-4fde-b97e-e72cbd93d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6854f0-17d1-4fde-b97e-e72cbd93d08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd18939-08da-4571-8321-cf11bdbe7a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume 48973eab-17d3-4b2b-9c47-af0b8a46b305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48973eab-17d3-4b2b-9c47-af0b8a46b305', 'volume_size': 1}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (3b222eba-fca0-405b-9541-aec749c98543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941c20d3-9c73-4379-b7d1-a880e3603631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941c20d3-9c73-4379-b7d1-a880e3603631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1719798205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9449a705-c673-4931-8cb4-b1676c2e4a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:42Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8377a2-cc11-4278-b535-dbe36c354901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8377a2-cc11-4278-b535-dbe36c354901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c0fa68-cefa-4404-b41d-0b7dbeebd215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c0fa68-cefa-4404-b41d-0b7dbeebd215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9449a705-c673-4931-8cb4-b1676c2e4a51', 'volume_name': 'volume-9449a705-c673-4931-8cb4-b1676c2e4a51', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549ae2b1-0746-4062-8ec8-2410af15ffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549ae2b1-0746-4062-8ec8-2410af15ffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d79050f-513f-46cb-8cfb-4599d1c2712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume 9449a705-c673-4931-8cb4-b1676c2e4a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9449a705-c673-4931-8cb4-b1676c2e4a51', 'volume_size': 1}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c" returned: 0 in 0.712s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.931s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-262739206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e45b1a-092c-4586-9084-bd8968207c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fb58fc787b48109f1d3ba3c38c0f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:35Z,use_quota=True,user_id='cac233f26e694cd79380d0f20590fba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Creating volume 08e45b1a-092c-4586-9084-bd8968207c91 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:41 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:41 devstack sudo[103957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91 1073741824
Jul 06 15:46:41 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b79664-a7e6-41a8-8e54-e98c0e22cfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d93cc6-f8d3-4acd-af12-f7ae41b6b2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:41 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Volume volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c (d0b8dc43-97e9-4369-81e3-fba4fb361d5c): created successfully
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d93cc6-f8d3-4acd-af12-f7ae41b6b2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Flow 'volume_create_manager' (39e0f1b3-54ba-4841-ad0e-1640fc31fd7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:41 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9191e787-985e-4e6a-b373-216a507bd5bc tempest-CreateVolumesFromImageTest-1096556451 None] Created volume successfully.
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (314a278c-32dc-4e37-947d-594c8f113029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e1b102-a01d-4664-b7d4-f65c8c1549af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e1b102-a01d-4664-b7d4-f65c8c1549af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1264284961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ff8220-8c56-41f1-bfba-c13899f2ba89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:42Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59e366c-9d94-4702-9276-e234da58fb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59e366c-9d94-4702-9276-e234da58fb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd7a4d1-8419-4af4-989e-64503a07c3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd7a4d1-8419-4af4-989e-64503a07c3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ff8220-8c56-41f1-bfba-c13899f2ba89', 'volume_name': 'volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a5bb35-2cc4-422b-b0e8-33acf09b3937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a5bb35-2cc4-422b-b0e8-33acf09b3937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8f4f24-4f3d-431c-aba0-925a6bab97d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:42 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume c3ff8220-8c56-41f1-bfba-c13899f2ba89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89', 'volume_size': 1}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (1a75564d-5cc6-4425-a1f6-f5a22259d825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec7d8a9-9be4-4536-bcec-8396dd6979d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec7d8a9-9be4-4536-bcec-8396dd6979d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1462570171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59577b78-0f27-4d3a-ba97-48ba6f2be989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:42Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8ca9ca-6f3f-4508-858e-2cf601bd7941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8ca9ca-6f3f-4508-858e-2cf601bd7941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a907c3-8650-48c7-95ef-2bf4a8d7a3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a907c3-8650-48c7-95ef-2bf4a8d7a3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59577b78-0f27-4d3a-ba97-48ba6f2be989', 'volume_name': 'volume-59577b78-0f27-4d3a-ba97-48ba6f2be989', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280e4d4b-d324-42c4-b537-d13e6175b677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280e4d4b-d324-42c4-b537-d13e6175b677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c34d434-ae07-458e-b74b-043a8d3086be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:42 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume 59577b78-0f27-4d3a-ba97-48ba6f2be989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59577b78-0f27-4d3a-ba97-48ba6f2be989', 'volume_size': 1}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:42 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91 1073741824" returned: 0 in 0.861s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:42 devstack sudo[103962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91
Jul 06 15:46:42 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:43 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91" returned: 0 in 0.590s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.069s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018228302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade86224-2dcb-4c74-8ad5-d90b742c926b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fb58fc787b48109f1d3ba3c38c0f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:35Z,use_quota=True,user_id='cac233f26e694cd79380d0f20590fba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Creating volume ade86224-2dcb-4c74-8ad5-d90b742c926b {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:43 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4744d93-4f36-4306-bbea-5b6f4e8adcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e45b1a-092c-4586-9084-bd8968207c91', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:43 devstack sudo[103965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b 1073741824
Jul 06 15:46:43 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a8c3ab-e9a7-409a-bc25-443b50dc4c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:43 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Volume volume-08e45b1a-092c-4586-9084-bd8968207c91 (08e45b1a-092c-4586-9084-bd8968207c91): created successfully
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a8c3ab-e9a7-409a-bc25-443b50dc4c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:43 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Flow 'volume_create_manager' (8995d4b8-3174-4955-bf0e-c55fe6bd6064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-66875d81-e6be-489b-a62b-ae88ce5ec76b tempest-CreateVolumesFromImageTest-1096556451 None] Created volume successfully.
Jul 06 15:46:44 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b 1073741824" returned: 0 in 0.788s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:44 devstack sudo[103971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b
Jul 06 15:46:44 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:44 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b" returned: 0 in 0.611s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.486s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a43be01-c701-40e7-ac02-d6d6ccfbaa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade86224-2dcb-4c74-8ad5-d90b742c926b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e38e73-0091-445f-9255-ca524313aa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Creating offline snapshot 5ed55e59-91c2-4d69-befa-e90a59745534 of volume fb2d9399-b634-4ea2-bcef-e03d8ca4666c {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:46:44 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Volume volume-ade86224-2dcb-4c74-8ad5-d90b742c926b (ade86224-2dcb-4c74-8ad5-d90b742c926b): created successfully
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e38e73-0091-445f-9255-ca524313aa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Flow 'volume_create_manager' (661abbb3-37eb-43a3-9d84-af8c7bdcf636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc51e5b-e5a8-47db-9578-0c5ed35a0440]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:44 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-45406761-b935-4c18-a272-57e1f516296d tempest-CreateVolumesFromImageTest-1096556451 None] Created volume successfully.
Jul 06 15:46:44 devstack sudo[103974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c
Jul 06 15:46:44 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:45 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" returned: 0 in 0.722s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:45 devstack sudo[103979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534 1G
Jul 06 15:46:45 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "cinder-ade86224-2dcb-4c74-8ad5-d90b742c926b-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-ade86224-2dcb-4c74-8ad5-d90b742c926b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "cinder-quobyte-ade86224-2dcb-4c74-8ad5-d90b742c926b" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:46 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-quobyte-ade86224-2dcb-4c74-8ad5-d90b742c926b" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[434e0c24-ab3d-4ea3-8221-3c6712772f59]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:46 devstack sudo[103981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b
Jul 06 15:46:46 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:46 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534 1G" returned: 0 in 0.851s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:46 devstack sudo[103986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534
Jul 06 15:46:46 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:46 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b" returned: 0 in 0.772s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:46 devstack sudo[103991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b
Jul 06 15:46:46 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:47 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534" returned: 0 in 0.688s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:47 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534 is being set with open permissions: ugo+rw
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:47 devstack sudo[103998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534
Jul 06 15:46:47 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:47 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ade86224-2dcb-4c74-8ad5-d90b742c926b" returned: 0 in 0.644s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-quobyte-ade86224-2dcb-4c74-8ad5-d90b742c926b" released by "delete_volume" :: held 1.457s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Created reservations ['7ecee87d-9852-4f94-8bbe-25215a727a0c', '4c15d7be-7ee7-4850-8d3e-92e6a7e4ea62', '44520d87-11ea-47db-937a-17d81ceac395', '2a4c7223-da2b-4ea8-a059-983f51cce1ee'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:47 devstack sudo[104002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:46:47 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:47 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534" returned: 0 in 0.643s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:47 devstack sudo[104004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.info
Jul 06 15:46:47 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "cinder-08e45b1a-092c-4586-9084-bd8968207c91-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-08e45b1a-092c-4586-9084-bd8968207c91-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "cinder-quobyte-08e45b1a-092c-4586-9084-bd8968207c91" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-quobyte-08e45b1a-092c-4586-9084-bd8968207c91" acquired by "delete_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92e4747-5776-487c-b4bb-b0598cd1d1c1]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:48 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.721s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:46:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Deleted volume successfully.
Jul 06 15:46:48 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.info" returned: 0 in 0.674s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:48 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.info is being set with open permissions: ugo+rw
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-627e141f-607c-408c-b220-70cea97754e3 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-ade86224-2dcb-4c74-8ad5-d90b742c926b-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:48 devstack sudo[104009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.info
Jul 06 15:46:48 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:48 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91
Jul 06 15:46:48 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:49 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91" returned: 0 in 0.769s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:49 devstack sudo[104016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91
Jul 06 15:46:49 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:49 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.info" returned: 0 in 0.743s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.456s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.346s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916005bd-90ec-4b16-bdea-fa85922de70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303ef950e20b4dc7915d7de3ef53cce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:37Z,use_quota=True,user_id='a828488b7eb14dee9e1efc7817289043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffd0c02c-b5e2-4c77-b444-85ea9b0af939),volume_type_id=ffd0c02c-b5e2-4c77-b444-85ea9b0af939)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Creating volume 916005bd-90ec-4b16-bdea-fa85922de70e {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:49 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:49 devstack sudo[104018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e 1073741824
Jul 06 15:46:49 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:49 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6c15ad7b-82dc-41c0-a58c-313e4ac1c641 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Create snapshot completed successfully
Jul 06 15:46:49 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-08e45b1a-092c-4586-9084-bd8968207c91" returned: 0 in 0.724s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-quobyte-08e45b1a-092c-4586-9084-bd8968207c91" released by "delete_volume" :: held 1.550s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Created reservations ['b0273055-94e8-4983-87ae-370664ae2ddb', '73a1cb7d-a77e-4285-9e7b-18acb8061b01', '81eb7d25-137a-4895-8002-8e42ebe555c2', '607af19d-66d6-46a4-a117-ff2916406219'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:50 devstack sudo[104025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:46:50 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:50 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e 1073741824" returned: 0 in 0.928s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:50 devstack sudo[104027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e
Jul 06 15:46:50 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (6fd99547-8bb6-4c33-8511-28aa79f58ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0e7435-d6b1-4162-8085-9f88f22b5a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0e7435-d6b1-4162-8085-9f88f22b5a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404482540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca736cff-a321-49d8-b172-761fc56fe6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:50Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79aabdaf-1dd5-4498-9a04-48913b13c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79aabdaf-1dd5-4498-9a04-48913b13c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2f37d4-9647-4eac-980c-99f5f0d49a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2f37d4-9647-4eac-980c-99f5f0d49a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca736cff-a321-49d8-b172-761fc56fe6cf', 'volume_name': 'volume-ca736cff-a321-49d8-b172-761fc56fe6cf', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7056d12-5825-40b6-a368-8fcaa8f1b871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7056d12-5825-40b6-a368-8fcaa8f1b871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae00369d-66c1-4020-84a5-62fb76f79b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:50 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume ca736cff-a321-49d8-b172-761fc56fe6cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca736cff-a321-49d8-b172-761fc56fe6cf', 'volume_size': 1}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "cinder-d0b8dc43-97e9-4369-81e3-fba4fb361d5c-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-d0b8dc43-97e9-4369-81e3-fba4fb361d5c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "cinder-quobyte-d0b8dc43-97e9-4369-81e3-fba4fb361d5c" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-quobyte-d0b8dc43-97e9-4369-81e3-fba4fb361d5c" acquired by "delete_volume" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8373f16f-c609-4f9e-a275-6522a3956c4f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (82f5635a-617a-48bf-9a26-c0df60642f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a352b94-3711-4130-aa12-29ad8034df47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a352b94-3711-4130-aa12-29ad8034df47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964156305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab69371a-c6b9-4306-91ca-3f269c68fbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:51Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d296824b-4e29-41f0-89ac-a1df12e545c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:50 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d296824b-4e29-41f0-89ac-a1df12e545c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06946deb-caaa-4199-830b-ee3cb7654671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06946deb-caaa-4199-830b-ee3cb7654671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab69371a-c6b9-4306-91ca-3f269c68fbc1', 'volume_name': 'volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d1d40f-ca26-4fbb-a105-cfd1f3817d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d1d40f-ca26-4fbb-a105-cfd1f3817d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:50 devstack sudo[104031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ed6cb6-d48b-4276-8449-c98ae64d7636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:50 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:50 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume ab69371a-c6b9-4306-91ca-3f269c68fbc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1', 'volume_size': 1}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.863s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:46:50 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Deleted volume successfully.
Jul 06 15:46:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5191d9cd-7b07-4856-87a2-f78f5a1f59dd tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-08e45b1a-092c-4586-9084-bd8968207c91-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:51 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e" returned: 0 in 1.015s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.181s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717381465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4536b5-a358-45bd-833d-8ac00806400a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:41Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Creating volume eb4536b5-a358-45bd-833d-8ac00806400a {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:51 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:51 devstack sudo[104034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a 1073741824
Jul 06 15:46:51 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (ac0f44dd-84f3-4935-bb25-56c70a064fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d08878-f3e4-4527-bece-9f5bcd270c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Attempting download of 31e87e4d-564b-4313-88dd-e3fca2d6e155 ((None, [{'url': 'file:///opt/stack/data/glance/images/31e87e4d-564b-4313-88dd-e3fca2d6e155', 'metadata': {}}])) to volume 916005bd-90ec-4b16-bdea-fa85922de70e. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d08878-f3e4-4527-bece-9f5bcd270c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093976924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:51Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf6fb3f-7776-4a5f-b595-66ef70439485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf6fb3f-7776-4a5f-b595-66ef70439485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6bdb80-f575-4784-b536-845b26c87e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6bdb80-f575-4784-b536-845b26c87e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f', 'volume_name': 'volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc2a67a-0687-439b-a8b7-7135a510a840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc2a67a-0687-439b-a8b7-7135a510a840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30cf163-a22c-4af2-80a2-78c3c427d9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:51 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume 52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f', 'volume_size': 1}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d54771b-3542-4496-ac4a-b0b82cacb457]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31e87e4d-564b-4313-88dd-e3fca2d6e155_b5r0ames {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (ee70a7d5-de7c-48f0-b337-f523a1e7732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb0d16c-4860-4009-83cd-fde82efb4e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb0d16c-4860-4009-83cd-fde82efb4e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1341858223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac5cd11-1caa-4180-a944-e9e7df047ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:52Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fccd0543-2bf3-4a6c-9018-2ed46b9bc350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fccd0543-2bf3-4a6c-9018-2ed46b9bc350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f449978c-5ed9-44b8-b3bf-c923000eb435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f449978c-5ed9-44b8-b3bf-c923000eb435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac5cd11-1caa-4180-a944-e9e7df047ea6', 'volume_name': 'volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f7b4ec-1dc1-48e5-b2dc-74e93691cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f7b4ec-1dc1-48e5-b2dc-74e93691cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab76956a-7e4f-42fb-881c-1fbfc60046f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:51 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume 5ac5cd11-1caa-4180-a944-e9e7df047ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6', 'volume_size': 1}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:51 devstack sudo[104038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31e87e4d-564b-4313-88dd-e3fca2d6e155_b5r0ames
Jul 06 15:46:51 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:51 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c" returned: 0 in 1.078s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:51 devstack sudo[104041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c
Jul 06 15:46:51 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (eef55cb2-c51a-408b-888a-26b4233a53ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad8bd39-a69c-48ce-95c7-4c2ea7e048e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad8bd39-a69c-48ce-95c7-4c2ea7e048e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1974691197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65dae38d-5215-4663-b681-6d7ce35c45d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:52Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77bfedc-bc9b-4d05-8fe0-692f3e06a961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77bfedc-bc9b-4d05-8fe0-692f3e06a961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6865fc21-08ea-45e2-8cff-45b229f93eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6865fc21-08ea-45e2-8cff-45b229f93eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65dae38d-5215-4663-b681-6d7ce35c45d1', 'volume_name': 'volume-65dae38d-5215-4663-b681-6d7ce35c45d1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af81e0ab-612c-4452-81e6-76bfcabf2250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af81e0ab-612c-4452-81e6-76bfcabf2250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2252515-4cb0-4bd5-95b8-40ede2821c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume 65dae38d-5215-4663-b681-6d7ce35c45d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65dae38d-5215-4663-b681-6d7ce35c45d1', 'volume_size': 1}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:52 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a 1073741824" returned: 0 in 1.076s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:52 devstack sudo[104047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a
Jul 06 15:46:52 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:52 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d0b8dc43-97e9-4369-81e3-fba4fb361d5c" returned: 0 in 0.722s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-quobyte-d0b8dc43-97e9-4369-81e3-fba4fb361d5c" released by "delete_volume" :: held 1.874s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:52 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31e87e4d-564b-4313-88dd-e3fca2d6e155_b5r0ames" returned: 0 in 1.055s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31e87e4d-564b-4313-88dd-e3fca2d6e155_b5r0ames {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Created reservations ['fd7477d7-a41e-4edb-99bd-24a626ad115c', '0ae3bc32-982f-4e38-ae4b-3952db951877', '93e203cb-0bc7-42d0-a4b1-cdaa0ba15cc1', 'f8db21cf-ad75-4039-951a-02efadf368a5'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:52 devstack sudo[104052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31e87e4d-564b-4313-88dd-e3fca2d6e155_b5r0ames
Jul 06 15:46:52 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:52 devstack sudo[104054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:46:52 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "cinder-18d3efaf-56a9-4028-b1b1-11ebfe354a00-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:52 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-18d3efaf-56a9-4028-b1b1-11ebfe354a00-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a" returned: 0 in 0.660s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.608s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-919092884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48973eab-17d3-4b2b-9c47-af0b8a46b305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:41Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Creating volume 48973eab-17d3-4b2b-9c47-af0b8a46b305 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:52 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:52 devstack sudo[104057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305 1073741824
Jul 06 15:46:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8120a0a-ce82-4eea-bf80-af2a172fe839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb4536b5-a358-45bd-833d-8ac00806400a', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:52 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01d1557-f767-49ac-bbff-0aa3ecb274d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:53 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume volume-eb4536b5-a358-45bd-833d-8ac00806400a (eb4536b5-a358-45bd-833d-8ac00806400a): created successfully
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01d1557-f767-49ac-bbff-0aa3ecb274d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (07d42000-89ba-4480-bcd0-8fdcfa6d792b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:53 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2b9da197-0593-492a-ad54-76ecca121f78 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created volume successfully.
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "cinder-quobyte-18d3efaf-56a9-4028-b1b1-11ebfe354a00" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-quobyte-18d3efaf-56a9-4028-b1b1-11ebfe354a00" acquired by "delete_volume" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[27904e90-f1a0-4f62-9128-4ef6fe199894]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:53 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00
Jul 06 15:46:53 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:53 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31e87e4d-564b-4313-88dd-e3fca2d6e155_b5r0ames" returned: 1 in 0.917s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31e87e4d-564b-4313-88dd-e3fca2d6e155_b5r0ames' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf02ba0-4456-4170-b796-45fb5a53a05a]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:53 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.819s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:46:53 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Deleted volume successfully.
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d007baae-8402-4bcc-81ff-e48414360e0b tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-d0b8dc43-97e9-4369-81e3-fba4fb361d5c-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:53 devstack sudo[104064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD
Jul 06 15:46:53 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:53 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305 1073741824" returned: 0 in 0.888s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:53 devstack sudo[104073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305
Jul 06 15:46:53 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:53 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00" returned: 0 in 0.796s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:53 devstack sudo[104075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00
Jul 06 15:46:53 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:54 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:54 devstack sudo[104079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD
Jul 06 15:46:54 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:54 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305" returned: 0 in 0.640s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.802s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1719798205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9449a705-c673-4931-8cb4-b1676c2e4a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:42Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Creating volume 9449a705-c673-4931-8cb4-b1676c2e4a51 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:54 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:54 devstack sudo[104083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51 1073741824
Jul 06 15:46:54 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd18939-08da-4571-8321-cf11bdbe7a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48973eab-17d3-4b2b-9c47-af0b8a46b305', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe592d98-9c6b-41ff-8918-97d3e53865be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:54 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:54 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume volume-48973eab-17d3-4b2b-9c47-af0b8a46b305 (48973eab-17d3-4b2b-9c47-af0b8a46b305): created successfully
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe592d98-9c6b-41ff-8918-97d3e53865be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (da2a58e8-cf91-4dd0-b89a-fef04ff86db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-18d3efaf-56a9-4028-b1b1-11ebfe354a00" returned: 0 in 0.705s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-quobyte-18d3efaf-56a9-4028-b1b1-11ebfe354a00" released by "delete_volume" :: held 1.568s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:54 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6d3c63e4-f9fc-4d8e-be13-15f94b9fcfc6 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created volume successfully.
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Created reservations ['ca022ddb-1f0e-4a90-8203-3906f3dbac2f', 'b98c32b6-5e43-4723-914b-d1c59f543bf7', '732907cb-732a-428a-aeaf-e876312b2f45', 'c2cf461a-7a17-4f63-ab31-6a0a6734b516'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:54 devstack sudo[104085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:46:54 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:55 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD" returned: 1 in 0.771s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] 31e87e4d-564b-4313-88dd-e3fca2d6e155 was raw, converting to raw {{(pid=86249) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "cinder-4137d6b5-0776-47c9-be38-3aea4ad11a1f-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:55 devstack sudo[104091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e
Jul 06 15:46:55 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-4137d6b5-0776-47c9-be38-3aea4ad11a1f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "cinder-quobyte-4137d6b5-0776-47c9-be38-3aea4ad11a1f" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-quobyte-4137d6b5-0776-47c9-be38-3aea4ad11a1f" acquired by "delete_volume" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b597f4d7-0359-46bf-950f-a0e6944ef65b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:55 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f
Jul 06 15:46:55 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:55 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51 1073741824" returned: 0 in 1.050s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:55 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.823s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:46:55 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51
Jul 06 15:46:55 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Deleted volume successfully.
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-560048b7-12ef-4c66-88f6-838fd40197b5 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-18d3efaf-56a9-4028-b1b1-11ebfe354a00-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:55 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e" returned: 0 in 0.817s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_31e87e4d-564b-4313-88dd-e3fca2d6e155_gd62yvhxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:46:55 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 15:46:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:56 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e 1G
Jul 06 15:46:56 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:56 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f" returned: 0 in 0.894s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:56 devstack sudo[104109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f
Jul 06 15:46:56 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:56 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51" returned: 0 in 0.664s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.187s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1264284961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ff8220-8c56-41f1-bfba-c13899f2ba89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:42Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Creating volume c3ff8220-8c56-41f1-bfba-c13899f2ba89 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:56 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d79050f-513f-46cb-8cfb-4599d1c2712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9449a705-c673-4931-8cb4-b1676c2e4a51', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:56 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89 1073741824
Jul 06 15:46:56 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8525a7f-d80e-4971-be85-16cba93f36f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:56 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume volume-9449a705-c673-4931-8cb4-b1676c2e4a51 (9449a705-c673-4931-8cb4-b1676c2e4a51): created successfully
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8525a7f-d80e-4971-be85-16cba93f36f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (3b222eba-fca0-405b-9541-aec749c98543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:56 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-16ede7f8-f0a4-42aa-975e-35182f550976 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created volume successfully.
Jul 06 15:46:56 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e 1G" returned: 0 in 0.733s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6544837a-82f5-4840-a742-8b8fc0cfd08b]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:56 devstack sudo[104116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e
Jul 06 15:46:56 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:56 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-4137d6b5-0776-47c9-be38-3aea4ad11a1f" returned: 0 in 0.755s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-quobyte-4137d6b5-0776-47c9-be38-3aea4ad11a1f" released by "delete_volume" :: held 1.702s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Created reservations ['b5acfc2b-9264-4d64-b6a1-006df8b4c671', '53da8942-7bcb-4031-9941-4c7833c12d42', '10a67180-11f8-45e3-8c68-f6a2bbf5d584', '8e1e3111-dc76-4e19-b4bc-42b58472efd8'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:57 devstack sudo[104123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:46:57 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:57 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89 1073741824" returned: 0 in 0.835s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:57 devstack sudo[104125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89
Jul 06 15:46:57 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:57 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e" returned: 0 in 0.839s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:57 devstack sudo[104129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e
Jul 06 15:46:57 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:57 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.713s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:46:57 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Deleted volume successfully.
Jul 06 15:46:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9a460a6d-3568-46e8-8fda-9e2297dce727 tempest-CreateVolumesFromImageTest-1096556451 None] Lock "cinder-4137d6b5-0776-47c9-be38-3aea4ad11a1f-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:46:58 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89" returned: 0 in 0.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.540s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1462570171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59577b78-0f27-4d3a-ba97-48ba6f2be989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e90104808dd42be8f1a5a92bf8f7233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:42Z,use_quota=True,user_id='5583c38fe94640a78aea63d08d248623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Creating volume 59577b78-0f27-4d3a-ba97-48ba6f2be989 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:58 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8f4f24-4f3d-431c-aba0-925a6bab97d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:58 devstack sudo[104133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989 1073741824
Jul 06 15:46:58 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76d8862-2e1a-48e4-83ca-323798ccebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:58 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89 (c3ff8220-8c56-41f1-bfba-c13899f2ba89): created successfully
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76d8862-2e1a-48e4-83ca-323798ccebec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (314a278c-32dc-4e37-947d-594c8f113029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:58 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8d2488d0-40f1-4d60-9082-0b8ebf26cc01 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created volume successfully.
Jul 06 15:46:58 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e" returned: 1 in 0.906s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Downloaded image 31e87e4d-564b-4313-88dd-e3fca2d6e155 ((None, [{'url': 'file:///opt/stack/data/glance/images/31e87e4d-564b-4313-88dd-e3fca2d6e155', 'metadata': {}}])) to volume 916005bd-90ec-4b16-bdea-fa85922de70e successfully. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Temporary image 31e87e4d-564b-4313-88dd-e3fca2d6e155 for user a828488b7eb14dee9e1efc7817289043 is deleted. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Marking volume 916005bd-90ec-4b16-bdea-fa85922de70e as bootable. {{(pid=86249) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Copying metadata from image 31e87e4d-564b-4313-88dd-e3fca2d6e155 to 916005bd-90ec-4b16-bdea-fa85922de70e. {{(pid=86249) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Creating volume glance metadata for volume 916005bd-90ec-4b16-bdea-fa85922de70e backed by image 31e87e4d-564b-4313-88dd-e3fca2d6e155 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '31e87e4d-564b-4313-88dd-e3fca2d6e155', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f09f5d9dbcc575848591d276043f8d61', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86249) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c38bf0-24d2-4bb5-8f27-41f60ffa8ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916005bd-90ec-4b16-bdea-fa85922de70e', 'volume_size': 1, 'image_id': '31e87e4d-564b-4313-88dd-e3fca2d6e155', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31e87e4d-564b-4313-88dd-e3fca2d6e155', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f09f5d9dbcc575848591d276043f8d61', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '303ef950e20b4dc7915d7de3ef53cce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed056f08304c976bea373b2b69a20405e215ccb522cc996c2875a3dccfe1f157397b1fc6ce561121ab66e7b03b873eb35d034961c14e5711c7c61b6f22b6520f', 'id': '31e87e4d-564b-4313-88dd-e3fca2d6e155', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31e87e4d-564b-4313-88dd-e3fca2d6e155/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2c909c050>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b2eb8e-3e60-417e-8bd7-8f967866774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:58 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Volume volume-916005bd-90ec-4b16-bdea-fa85922de70e (916005bd-90ec-4b16-bdea-fa85922de70e): created successfully
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b2eb8e-3e60-417e-8bd7-8f967866774d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Flow 'volume_create_manager' (6e16a845-385c-437a-9724-1295bf20517e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:58 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2597340f-cad8-42c9-bdb2-2ab2ef8aef57 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Created volume successfully.
Jul 06 15:46:59 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989 1073741824" returned: 0 in 1.006s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:59 devstack sudo[104143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989
Jul 06 15:46:59 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:59 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989" returned: 0 in 0.632s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.393s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404482540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca736cff-a321-49d8-b172-761fc56fe6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:50Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Creating volume ca736cff-a321-49d8-b172-761fc56fe6cf {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:46:59 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:46:59 devstack sudo[104146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf 1073741824
Jul 06 15:46:59 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c34d434-ae07-458e-b74b-043a8d3086be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59577b78-0f27-4d3a-ba97-48ba6f2be989', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da86b23-cc80-443d-b2f5-94cfd240a8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:46:59 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Volume volume-59577b78-0f27-4d3a-ba97-48ba6f2be989 (59577b78-0f27-4d3a-ba97-48ba6f2be989): created successfully
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da86b23-cc80-443d-b2f5-94cfd240a8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Flow 'volume_create_manager' (1a75564d-5cc6-4425-a1f6-f5a22259d825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Acquiring lock "cinder-916005bd-90ec-4b16-bdea-fa85922de70e-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:59 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3de239f0-41a1-4c24-b93e-35879aa61964 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created volume successfully.
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Lock "cinder-916005bd-90ec-4b16-bdea-fa85922de70e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Acquiring lock "cinder-quobyte-916005bd-90ec-4b16-bdea-fa85922de70e" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Lock "cinder-quobyte-916005bd-90ec-4b16-bdea-fa85922de70e" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c88c062-d88e-4624-a6b0-0351c2f0f47c]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:46:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-59577b78-0f27-4d3a-ba97-48ba6f2be989-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-59577b78-0f27-4d3a-ba97-48ba6f2be989-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:00 devstack sudo[104148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e
Jul 06 15:47:00 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-quobyte-59577b78-0f27-4d3a-ba97-48ba6f2be989" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-59577b78-0f27-4d3a-ba97-48ba6f2be989" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1341d99c-061f-4f53-b7dc-87bf2e586863]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:00 devstack sudo[104150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989
Jul 06 15:47:00 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:00 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf 1073741824" returned: 0 in 1.066s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:00 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e" returned: 0 in 0.900s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:00 devstack sudo[104159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf
Jul 06 15:47:00 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Flow 'volume_create_manager' (2dc54f6b-687c-4d9b-b917-62db9d799b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:00 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b7b144-a6c9-4a3e-a8a6-d9ebd85e2b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b7b144-a6c9-4a3e-a8a6-d9ebd85e2b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1804444082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a08cbd-d78f-4037-84ac-72459239296b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ffaf23a74c47ee9e24e479a5ce7b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:01Z,use_quota=True,user_id='f3c868f3fe7949038544aad064564d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3f360e-3596-4c0f-b944-d726a5e1e344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3f360e-3596-4c0f-b944-d726a5e1e344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925706e7-48b8-48f6-8a00-5b8326ca3c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:01 devstack sudo[104160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e
Jul 06 15:47:01 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925706e7-48b8-48f6-8a00-5b8326ca3c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06a08cbd-d78f-4037-84ac-72459239296b', 'volume_name': 'volume-06a08cbd-d78f-4037-84ac-72459239296b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be753a4-de12-4097-9ffd-3738e0b858fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be753a4-de12-4097-9ffd-3738e0b858fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a5503d-8d3b-439b-8ce1-722e10310257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:01 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Volume 06a08cbd-d78f-4037-84ac-72459239296b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06a08cbd-d78f-4037-84ac-72459239296b', 'volume_size': 1}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:01 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989" returned: 0 in 0.922s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:01 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989
Jul 06 15:47:01 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:01 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf" returned: 0 in 0.699s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.694s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964156305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab69371a-c6b9-4306-91ca-3f269c68fbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:51Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Creating volume ab69371a-c6b9-4306-91ca-3f269c68fbc1 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:01 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae00369d-66c1-4020-84a5-62fb76f79b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca736cff-a321-49d8-b172-761fc56fe6cf', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a98d36-6431-423c-8805-8d5d1aa00df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:01 devstack sudo[104169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1 1073741824
Jul 06 15:47:01 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:01 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume volume-ca736cff-a321-49d8-b172-761fc56fe6cf (ca736cff-a321-49d8-b172-761fc56fe6cf): created successfully
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a98d36-6431-423c-8805-8d5d1aa00df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (6fd99547-8bb6-4c33-8511-28aa79f58ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:01 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-cfe73a43-dad9-4756-98cf-7b8de2b19689 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created volume successfully.
Jul 06 15:47:01 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e" returned: 1 in 0.915s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:01 devstack sudo[104175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e
Jul 06 15:47:01 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:01 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-59577b78-0f27-4d3a-ba97-48ba6f2be989" returned: 0 in 0.719s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-59577b78-0f27-4d3a-ba97-48ba6f2be989" released by "delete_volume" :: held 1.686s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created reservations ['678e96e1-24fd-4a60-a5f5-1b663ab72777', 'b4f8152c-6c04-4871-ac5d-767dab7de623', 'b7fcde9f-f466-46e4-b550-6e4daec1939e', 'd42cf95e-ada6-4930-a30f-93c2a4efc198'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:02 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:02 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-c3ff8220-8c56-41f1-bfba-c13899f2ba89-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-c3ff8220-8c56-41f1-bfba-c13899f2ba89-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-quobyte-c3ff8220-8c56-41f1-bfba-c13899f2ba89" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-c3ff8220-8c56-41f1-bfba-c13899f2ba89" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f23029-6456-4b18-9953-d52bb2c86f15]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:02 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-916005bd-90ec-4b16-bdea-fa85922de70e" returned: 0 in 0.748s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Lock "cinder-quobyte-916005bd-90ec-4b16-bdea-fa85922de70e" released by "delete_volume" :: held 2.651s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:02 devstack sudo[104183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89
Jul 06 15:47:02 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Created reservations ['21276d44-4ce4-4a4b-a0bb-ca98b16931fb', 'c03542fd-9edd-408f-9989-5621d3afd84d', '00125014-75c7-439f-87a7-246e726261a8', 'b3d6c1ab-1bc4-444f-b7be-8212bfab7cbc'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:02 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1 1073741824" returned: 0 in 1.233s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:02 devstack sudo[104187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:02 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:02 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.868s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:02 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Deleted volume successfully.
Jul 06 15:47:02 devstack sudo[104189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1
Jul 06 15:47:02 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1a625ffe-4285-4744-aa34-e77d78f30db9 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-59577b78-0f27-4d3a-ba97-48ba6f2be989-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:03 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89" returned: 0 in 0.903s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:03 devstack sudo[104195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89
Jul 06 15:47:03 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:03 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:03 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1" returned: 0 in 0.754s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.238s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093976924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:51Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Creating volume 52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:03 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.847s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:03 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Deleted volume successfully.
Jul 06 15:47:03 devstack sudo[104198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f 1073741824
Jul 06 15:47:03 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ed6cb6-d48b-4276-8449-c98ae64d7636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf437fe-f351-43af-8a8f-ea3c6e5c7f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:03 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1 (ab69371a-c6b9-4306-91ca-3f269c68fbc1): created successfully
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf437fe-f351-43af-8a8f-ea3c6e5c7f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (82f5635a-617a-48bf-9a26-c0df60642f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-754ca6b5-56f2-4e31-8718-7f9bf2d68a88 tempest-VolumeAndVolumeTypeFromImageTest-654263940 None] Lock "cinder-916005bd-90ec-4b16-bdea-fa85922de70e-delete_volume" released by "delete_volume" :: held 3.864s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:03 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-bea3f4c3-1932-4d4c-98bb-998ed4c5d57a tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created volume successfully.
Jul 06 15:47:04 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c3ff8220-8c56-41f1-bfba-c13899f2ba89" returned: 0 in 0.779s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-c3ff8220-8c56-41f1-bfba-c13899f2ba89" released by "delete_volume" :: held 1.735s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created reservations ['c8a887a7-1091-4a10-a812-3211c5221c22', 'abcd6bf8-4299-4c14-9d3c-1d6768d6f0d2', '9ecf23e1-6a3f-4b44-82b6-42abf81c8fb2', '1747f550-9a2d-4744-9cda-aa6bc4833c5c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:04 devstack sudo[104204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:04 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:04 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f 1073741824" returned: 0 in 1.042s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-9449a705-c673-4931-8cb4-b1676c2e4a51-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-9449a705-c673-4931-8cb4-b1676c2e4a51-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:04 devstack sudo[104207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f
Jul 06 15:47:04 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-quobyte-9449a705-c673-4931-8cb4-b1676c2e4a51" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-9449a705-c673-4931-8cb4-b1676c2e4a51" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fa7efd-fd3e-4b0e-8d44-775c37706852]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:04 devstack sudo[104209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51
Jul 06 15:47:04 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:05 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.808s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:05 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Deleted volume successfully.
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7080d8d5-68a7-4a32-ae74-f565944ec635 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-c3ff8220-8c56-41f1-bfba-c13899f2ba89-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:05 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f" returned: 0 in 0.795s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.848s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1341858223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac5cd11-1caa-4180-a944-e9e7df047ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:52Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Creating volume 5ac5cd11-1caa-4180-a944-e9e7df047ea6 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:05 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:05 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6 1073741824
Jul 06 15:47:05 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30cf163-a22c-4af2-80a2-78c3c427d9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8759c010-989f-4458-91b2-5598c4e1e707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:05 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f (52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f): created successfully
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8759c010-989f-4458-91b2-5598c4e1e707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (ac0f44dd-84f3-4935-bb25-56c70a064fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:05 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4ade2708-d2cf-4a33-af45-9f0f09b83fe4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created volume successfully.
Jul 06 15:47:05 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51" returned: 0 in 0.932s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:05 devstack sudo[104218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51
Jul 06 15:47:05 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:06 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6 1073741824" returned: 0 in 0.979s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:06 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9449a705-c673-4931-8cb4-b1676c2e4a51" returned: 0 in 0.766s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-9449a705-c673-4931-8cb4-b1676c2e4a51" released by "delete_volume" :: held 1.751s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:06 devstack sudo[104225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6
Jul 06 15:47:06 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created reservations ['16667c05-1c4f-4408-9a69-7d462b42e5b5', 'ae1722b1-3b64-4a47-a23d-9615d951dd3a', '672d0066-6200-4c8b-bdde-7b677e4ff551', 'fd692147-3652-4e79-9b92-ccb39893caee'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:06 devstack sudo[104227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:06 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:06 devstack sudo[104229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:06 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-48973eab-17d3-4b2b-9c47-af0b8a46b305-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-48973eab-17d3-4b2b-9c47-af0b8a46b305-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-quobyte-48973eab-17d3-4b2b-9c47-af0b8a46b305" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-48973eab-17d3-4b2b-9c47-af0b8a46b305" acquired by "delete_volume" :: waited 0.038s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e485325-9334-4186-a882-099dbe68a9a4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:07 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6" returned: 0 in 0.801s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.298s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1974691197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65dae38d-5215-4663-b681-6d7ce35c45d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5918a64bf4050a1292452ca544884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:52Z,use_quota=True,user_id='7964dd9a77024031bcede903d80ee48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Creating volume 65dae38d-5215-4663-b681-6d7ce35c45d1 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:07 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:07 devstack sudo[104233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305
Jul 06 15:47:07 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab76956a-7e4f-42fb-881c-1fbfc60046f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780bbd12-7cb1-45c7-96c7-09c1b6d7b313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:07 devstack sudo[104234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1 1073741824
Jul 06 15:47:07 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:07 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6 (5ac5cd11-1caa-4180-a944-e9e7df047ea6): created successfully
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780bbd12-7cb1-45c7-96c7-09c1b6d7b313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (ee70a7d5-de7c-48f0-b337-f523a1e7732b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:07 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2ea23254-c5f6-44ad-baa7-576f3b45f4f4 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created volume successfully.
Jul 06 15:47:07 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.963s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:47:07 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.993s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:07 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Deleted volume successfully.
Jul 06 15:47:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-28796695-7615-4a1a-ba45-aa999ef3bdc0 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-9449a705-c673-4931-8cb4-b1676c2e4a51-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:08 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305" returned: 0 in 0.967s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:08 devstack sudo[104245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305
Jul 06 15:47:08 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:08 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1 1073741824" returned: 0 in 1.087s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:08 devstack sudo[104248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1
Jul 06 15:47:08 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:08 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-48973eab-17d3-4b2b-9c47-af0b8a46b305" returned: 0 in 0.701s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-48973eab-17d3-4b2b-9c47-af0b8a46b305" released by "delete_volume" :: held 1.740s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:08 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created reservations ['0bdac712-9177-4701-b2ff-8ae5475fa501', '5ad82902-8717-4728-bb1e-1221f36a1524', '63ef6a26-c82a-42d9-8d68-7163fa12e4da', '6d4efd61-1c30-4fd6-84c2-145857572dbd'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:09 devstack sudo[104251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:09 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:09 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1" returned: 0 in 0.705s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.193s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1804444082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a08cbd-d78f-4037-84ac-72459239296b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ffaf23a74c47ee9e24e479a5ce7b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:01Z,use_quota=True,user_id='f3c868f3fe7949038544aad064564d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Creating volume 06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:09 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:09 devstack sudo[104254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b 1073741824
Jul 06 15:47:09 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2252515-4cb0-4bd5-95b8-40ede2821c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65dae38d-5215-4663-b681-6d7ce35c45d1', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f3af21-b75a-4555-a15b-b3c34be9e8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:09 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Volume volume-65dae38d-5215-4663-b681-6d7ce35c45d1 (65dae38d-5215-4663-b681-6d7ce35c45d1): created successfully
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f3af21-b75a-4555-a15b-b3c34be9e8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Flow 'volume_create_manager' (eef55cb2-c51a-408b-888a-26b4233a53ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:09 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ca94c5a2-f163-4d15-9f6d-bd303a0cf63e tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created volume successfully.
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-eb4536b5-a358-45bd-833d-8ac00806400a-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-eb4536b5-a358-45bd-833d-8ac00806400a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-quobyte-eb4536b5-a358-45bd-833d-8ac00806400a" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-eb4536b5-a358-45bd-833d-8ac00806400a" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0b793e-91e5-433e-a3c3-9e1808499715]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-65dae38d-5215-4663-b681-6d7ce35c45d1-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:09 devstack sudo[104257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a
Jul 06 15:47:09 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-65dae38d-5215-4663-b681-6d7ce35c45d1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-quobyte-65dae38d-5215-4663-b681-6d7ce35c45d1" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-65dae38d-5215-4663-b681-6d7ce35c45d1" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da2a2e6-cb78-4ab2-9281-1a5cc55ee266]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:09 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.771s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:09 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Deleted volume successfully.
Jul 06 15:47:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f1c2267e-d591-4503-b84f-eb6ecc4ef2da tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-48973eab-17d3-4b2b-9c47-af0b8a46b305-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:09 devstack sudo[104261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1
Jul 06 15:47:09 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:10 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b 1073741824" returned: 0 in 0.912s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:10 devstack sudo[104266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b
Jul 06 15:47:10 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:10 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a" returned: 0 in 0.897s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:10 devstack sudo[104272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a
Jul 06 15:47:10 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:10 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1" returned: 0 in 0.838s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:10 devstack sudo[104277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1
Jul 06 15:47:10 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:10 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b" returned: 0 in 0.774s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a5503d-8d3b-439b-8ce1-722e10310257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a08cbd-d78f-4037-84ac-72459239296b', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fc8541-51e3-4010-8396-01d373928187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:11 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Volume volume-06a08cbd-d78f-4037-84ac-72459239296b (06a08cbd-d78f-4037-84ac-72459239296b): created successfully
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fc8541-51e3-4010-8396-01d373928187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Flow 'volume_create_manager' (2dc54f6b-687c-4d9b-b917-62db9d799b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:11 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c29a0cf4-b645-4c66-b40e-09ff8d122294 tempest-VolumeDependencyTests-566952354 None] Created volume successfully.
Jul 06 15:47:11 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-eb4536b5-a358-45bd-833d-8ac00806400a" returned: 0 in 0.793s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-eb4536b5-a358-45bd-833d-8ac00806400a" released by "delete_volume" :: held 1.747s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created reservations ['f3934e2f-0a28-464a-b5d3-f9f0893ca4e8', 'e6434429-fa2a-41af-94c9-56db9fdcc35d', '40ef4037-7cb2-423f-89e7-a65826400e27', '7af3c9e9-7b4b-4702-a0e0-cf184c190246'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:11 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-65dae38d-5215-4663-b681-6d7ce35c45d1" returned: 0 in 0.770s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:11 devstack sudo[104282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:11 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-65dae38d-5215-4663-b681-6d7ce35c45d1" released by "delete_volume" :: held 1.661s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created reservations ['991450b1-7020-4948-80c9-5f1a1683069f', '74467846-a7df-4016-8c6e-15d71385743a', 'f6b5b154-a3cd-4478-9f0d-d87a3cd907cc', '359b96d0-628d-4313-977d-55099b99ed5a'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:11 devstack sudo[104284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:11 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-a7f96517-1d63-40d6-a3a9-40f39fce1a46-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-a7f96517-1d63-40d6-a3a9-40f39fce1a46-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "cinder-quobyte-a7f96517-1d63-40d6-a3a9-40f39fce1a46" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-a7f96517-1d63-40d6-a3a9-40f39fce1a46" acquired by "delete_volume" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4358562e-632e-402f-ac22-f628944690e3]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:11 devstack sudo[104286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46
Jul 06 15:47:11 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:11 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-5ac5cd11-1caa-4180-a944-e9e7df047ea6-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-5ac5cd11-1caa-4180-a944-e9e7df047ea6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Creating offline snapshot 9e86e483-4cb0-4ef3-9462-550406afbded of volume 06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:47:12 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-quobyte-5ac5cd11-1caa-4180-a944-e9e7df047ea6" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[483fd3ef-0e32-4dc4-8a86-c560be9fa3a9]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.761s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Deleted volume successfully.
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-5ac5cd11-1caa-4180-a944-e9e7df047ea6" acquired by "delete_volume" :: waited 0.041s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e3c96f-66e0-433f-8327-a58b4dbbb16a]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-b5e826a9-3479-49df-a320-5094581ca2a4 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-eb4536b5-a358-45bd-833d-8ac00806400a-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:12 devstack sudo[104289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b
Jul 06 15:47:12 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:12 devstack sudo[104290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6
Jul 06 15:47:12 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:12 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.938s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Deleted volume successfully.
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8b904570-af36-4efe-9b07-de3c38241852 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-65dae38d-5215-4663-b681-6d7ce35c45d1-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:12 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46" returned: 0 in 0.970s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:12 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46
Jul 06 15:47:12 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:13 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b" returned: 0 in 0.992s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:13 devstack sudo[104306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded 1G
Jul 06 15:47:13 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:13 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6" returned: 0 in 1.060s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:13 devstack sudo[104308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6
Jul 06 15:47:13 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:13 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-a7f96517-1d63-40d6-a3a9-40f39fce1a46" returned: 0 in 0.801s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-quobyte-a7f96517-1d63-40d6-a3a9-40f39fce1a46" released by "delete_volume" :: held 1.828s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Created reservations ['f1369168-a83c-4043-a7c6-aa589804e176', 'a7e5b131-bcff-493c-b122-51cdca44dbdc', '3f0fc8e9-fefb-49b5-aebd-fd97e1e85d5b', '96a0f23f-207f-4b15-919b-09656566cc40'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:13 devstack sudo[104314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:13 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:14 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded 1G" returned: 0 in 1.071s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a08cbd-d78f-4037-84ac-72459239296b -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:14 devstack sudo[104317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a08cbd-d78f-4037-84ac-72459239296b -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded
Jul 06 15:47:14 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:14 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-5ac5cd11-1caa-4180-a944-e9e7df047ea6" returned: 0 in 1.007s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-5ac5cd11-1caa-4180-a944-e9e7df047ea6" released by "delete_volume" :: held 2.140s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created reservations ['9ee62f2f-b567-4e97-8563-0ee5d05d5b8d', '48a82f99-f6bd-49cb-b2ad-671f26077189', '5c4180b7-ad05-40ce-939a-2e3452ff331a', '89fb9f2b-b3e9-41d1-a0f2-f56f087684ad'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:14 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:14 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:14 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.971s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:14 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Deleted volume successfully.
Jul 06 15:47:14 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e8ca4f3d-3b7a-4738-826d-d1db3c828f65 tempest-CreateVolumesFromSourceVolumeTest-841872050 None] Lock "cinder-a7f96517-1d63-40d6-a3a9-40f39fce1a46-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:15 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a08cbd-d78f-4037-84ac-72459239296b -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded" returned: 0 in 1.218s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:15 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded is being set with open permissions: ugo+rw
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:15 devstack sudo[104340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded
Jul 06 15:47:15 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:15 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.959s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Deleted volume successfully.
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50dab0b9-036f-486c-a4d3-aea1fd118c86 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-5ac5cd11-1caa-4180-a944-e9e7df047ea6-delete_volume" released by "delete_volume" :: held 3.529s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-quobyte-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1047eb6f-8608-4c64-b346-552434bc9ef2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:15 devstack sudo[104362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f
Jul 06 15:47:15 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:16 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded" returned: 0 in 1.097s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:16 devstack sudo[104369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.info
Jul 06 15:47:16 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:16 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f" returned: 0 in 1.117s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:16 devstack sudo[104374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f
Jul 06 15:47:16 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:17 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.info" returned: 0 in 0.761s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:17 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.info is being set with open permissions: ugo+rw
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:17 devstack sudo[104377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.info
Jul 06 15:47:17 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:17 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f" returned: 0 in 0.728s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f" released by "delete_volume" :: held 1.921s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created reservations ['6506cb96-0ef8-4e33-a3ae-997c9e443d4e', '5ebf10a3-c505-4604-b65f-9e6c6c3b8e1b', '34d03c65-a17e-46d1-af83-5bfa8bf0f3aa', '7b2553e5-77d1-481e-a70a-692177f0cb4b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:17 devstack sudo[104380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:17 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-ab69371a-c6b9-4306-91ca-3f269c68fbc1-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-ab69371a-c6b9-4306-91ca-3f269c68fbc1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:17 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-quobyte-ab69371a-c6b9-4306-91ca-3f269c68fbc1" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-ab69371a-c6b9-4306-91ca-3f269c68fbc1" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc54aa98-d277-4667-96a4-debab4a8cdbe]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:18 devstack sudo[104382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1
Jul 06 15:47:18 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Flow 'volume_create_manager' (2e6cb847-e0a1-47c0-8a5b-4e35d180b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8ce822-8e6c-4a57-87f0-07f77a6dc145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8ce822-8e6c-4a57-87f0-07f77a6dc145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742216100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9159452e-2f67-4619-b4f1-305cc5090fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22986b8c36a84778a805e9b9d2731ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:18Z,use_quota=True,user_id='256caa41a68d439988c200637b5b8939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a6440c-9faa-498e-bea2-1aa404791bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a6440c-9faa-498e-bea2-1aa404791bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa19916-75d6-46ff-8075-495baf8513ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa19916-75d6-46ff-8075-495baf8513ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9159452e-2f67-4619-b4f1-305cc5090fa3', 'volume_name': 'volume-9159452e-2f67-4619-b4f1-305cc5090fa3', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b25945-3ce0-4e2d-acf0-8e3b37efc02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b25945-3ce0-4e2d-acf0-8e3b37efc02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e81ea1-24bf-434a-a81c-6e58cc7a06fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:18 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Volume 9159452e-2f67-4619-b4f1-305cc5090fa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9159452e-2f67-4619-b4f1-305cc5090fa3', 'volume_size': 1}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:18 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.info" returned: 0 in 1.090s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.378s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742216100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9159452e-2f67-4619-b4f1-305cc5090fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22986b8c36a84778a805e9b9d2731ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:18Z,use_quota=True,user_id='256caa41a68d439988c200637b5b8939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Creating volume 9159452e-2f67-4619-b4f1-305cc5090fa3 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:18 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:18 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3314a925-050a-4303-ab89-1959559b5636 tempest-VolumeDependencyTests-566952354 None] Create snapshot completed successfully
Jul 06 15:47:18 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3 1073741824
Jul 06 15:47:18 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:18 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.988s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:18 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Deleted volume successfully.
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-221dd0dd-8276-4855-b9f8-d033a0a2472c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-52d7cd9d-e2bf-4fff-b462-6dc2c3257a8f-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:18 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1" returned: 0 in 0.943s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:19 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1
Jul 06 15:47:19 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:19 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3 1073741824" returned: 0 in 0.948s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:19 devstack sudo[104397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3
Jul 06 15:47:19 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:19 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ab69371a-c6b9-4306-91ca-3f269c68fbc1" returned: 0 in 0.783s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-ab69371a-c6b9-4306-91ca-3f269c68fbc1" released by "delete_volume" :: held 1.790s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created reservations ['97829be9-a75f-4a83-89ce-1a15109eaedd', 'ab02ce42-b531-483a-b7c7-cdd7be5da0a0', '1cb4a9ee-ada2-4930-a328-cedeba4f877d', 'd0e348df-f64f-4a60-9060-e9320c84ac2b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:20 devstack sudo[104400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:20 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Flow 'volume_create_manager' (c3dd3b61-f0df-41fc-9cf8-38a14fd96699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fb59c0-6aee-4309-ae2f-864dff549515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fb59c0-6aee-4309-ae2f-864dff549515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-419475584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a21710-86e6-4839-ba1e-f9cbf89ae93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ffaf23a74c47ee9e24e479a5ce7b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e86e483-4cb0-4ef3-9462-550406afbded,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:20Z,use_quota=True,user_id='f3c868f3fe7949038544aad064564d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:20 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabeb4e9-ea6a-4388-9142-27abcc2fb226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabeb4e9-ea6a-4388-9142-27abcc2fb226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7384ee24-a963-49e8-a3b4-eacc5c346735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7384ee24-a963-49e8-a3b4-eacc5c346735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2a21710-86e6-4839-ba1e-f9cbf89ae93c', 'volume_name': 'volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c', 'volume_size': 1, 'snapshot_id': '9e86e483-4cb0-4ef3-9462-550406afbded'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80800f01-bb28-47ef-812b-3ab75eccc607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80800f01-bb28-47ef-812b-3ab75eccc607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa24cfd-cb90-4c8f-b1b4-44e99e896e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:20 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Volume c2a21710-86e6-4839-ba1e-f9cbf89ae93c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c', 'volume_size': 1, 'snapshot_id': '9e86e483-4cb0-4ef3-9462-550406afbded'}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-ca736cff-a321-49d8-b172-761fc56fe6cf-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3" returned: 0 in 0.914s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Acquiring lock "cinder-quobyte-9e86e483-4cb0-4ef3-9462-550406afbded-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" by "_create_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-ca736cff-a321-49d8-b172-761fc56fe6cf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e81ea1-24bf-434a-a81c-6e58cc7a06fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9159452e-2f67-4619-b4f1-305cc5090fa3', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a60bb1-31c8-4289-8b5c-7c50fdd9f21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-9e86e483-4cb0-4ef3-9462-550406afbded-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Creating volume c2a21710-86e6-4839-ba1e-f9cbf89ae93c from snapshot 9e86e483-4cb0-4ef3-9462-550406afbded {{(pid=86249) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Acquiring lock "cinder-quobyte-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:20 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Volume volume-9159452e-2f67-4619-b4f1-305cc5090fa3 (9159452e-2f67-4619-b4f1-305cc5090fa3): created successfully
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a60bb1-31c8-4289-8b5c-7c50fdd9f21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Flow 'volume_create_manager' (2e6cb847-e0a1-47c0-8a5b-4e35d180b941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:20 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9479614a-a8a8-49f5-9d8c-a824d3d8d7fc tempest-ProjectReaderTests-2035225243 None] Created volume successfully.
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] snapshot: 9e86e483-4cb0-4ef3-9462-550406afbded, volume: c2a21710-86e6-4839-ba1e-f9cbf89ae93c,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-quobyte-ca736cff-a321-49d8-b172-761fc56fe6cf" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c44dd72-f2b0-4d47-9f66-b99d222ddbd6]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-ca736cff-a321-49d8-b172-761fc56fe6cf" acquired by "delete_volume" :: waited 0.029s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad973d7e-de41-408e-8f73-17245c692021]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:20 devstack sudo[104404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded
Jul 06 15:47:20 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:20 devstack sudo[104405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf
Jul 06 15:47:20 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:20 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.843s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:20 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Deleted volume successfully.
Jul 06 15:47:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-16bba0fa-c635-4e9b-b730-da4da400c87c tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-ab69371a-c6b9-4306-91ca-3f269c68fbc1-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:21 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded" returned: 0 in 0.914s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:21 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a08cbd-d78f-4037-84ac-72459239296b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf" returned: 0 in 0.880s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0dfeb7-bb5c-4ec4-a836-bedb5b670bf4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:21 devstack sudo[104416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf
Jul 06 15:47:21 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:21 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b
Jul 06 15:47:21 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Acquiring lock "cinder-9159452e-2f67-4619-b4f1-305cc5090fa3-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Lock "cinder-9159452e-2f67-4619-b4f1-305cc5090fa3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Acquiring lock "cinder-quobyte-9159452e-2f67-4619-b4f1-305cc5090fa3" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Lock "cinder-quobyte-9159452e-2f67-4619-b4f1-305cc5090fa3" acquired by "delete_volume" :: waited 0.029s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4df9a52-f206-4d1c-b0c3-063a01d543b2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:22 devstack sudo[104420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3
Jul 06 15:47:22 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ca736cff-a321-49d8-b172-761fc56fe6cf" returned: 0 in 0.795s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:22 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-ca736cff-a321-49d8-b172-761fc56fe6cf" released by "delete_volume" :: held 1.732s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created reservations ['f543a679-c4f3-458d-bfcb-85a3ae0b2b8f', '8108e54b-7aa2-42a4-9a17-b6fa31977e09', '2a42bab7-d81b-424a-8166-6e0cd3a65b23', 'c0919c57-dcfc-42aa-9f91-72c07d5fb269'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:22 devstack sudo[104425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:22 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-5ed55e59-91c2-4d69-befa-e90a59745534-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-5ed55e59-91c2-4d69-befa-e90a59745534-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-quobyte-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-quobyte-5ed55e59-91c2-4d69-befa-e90a59745534" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-5ed55e59-91c2-4d69-befa-e90a59745534" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:22 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Deleting offline snapshot 5ed55e59-91c2-4d69-befa-e90a59745534 of volume fb2d9399-b634-4ea2-bcef-e03d8ca4666c {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] snapshot_file for this snap is: volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b" returned: 0 in 1.303s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dc113e-0e9c-41a3-970b-5a92dd0c05d2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:22 devstack sudo[104432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c
Jul 06 15:47:22 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:22 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3" returned: 0 in 0.970s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:22 devstack sudo[104433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534
Jul 06 15:47:22 devstack sudo[104435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3
Jul 06 15:47:22 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:22 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:23 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.002s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:23 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:23 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Deleted volume successfully.
Jul 06 15:47:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7c9ad1d-4676-4968-80c6-21e90fdfb6f0 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-ca736cff-a321-49d8-b172-761fc56fe6cf-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:23 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-9159452e-2f67-4619-b4f1-305cc5090fa3" returned: 0 in 0.759s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Lock "cinder-quobyte-9159452e-2f67-4619-b4f1-305cc5090fa3" released by "delete_volume" :: held 1.784s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:23 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Created reservations ['1cf22dbf-fee4-4b2e-99ba-3a4736a69a1d', 'b0973f5d-987c-4536-a1b6-4d1620f79faf', 'f70d5283-5f39-4a3f-ba1b-154b1a1f76f9', '99f0d432-ff1c-4905-84e5-fad97495adc9'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:23 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534" returned: 0 in 1.066s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:47:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[031b78dd-00df-4d1c-be88-df540cb2d1c1]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:24 devstack sudo[104455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:24 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:24 devstack sudo[104454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c
Jul 06 15:47:24 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Flow 'volume_create_manager' (c60379c7-527f-4464-a580-d278ea6818dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747ee639-88a0-4ba9-b738-2e53b9d85c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747ee639-88a0-4ba9-b738-2e53b9d85c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-585235848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62015219-04ab-4ddd-82f7-25773c70d9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22986b8c36a84778a805e9b9d2731ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:26Z,use_quota=True,user_id='256caa41a68d439988c200637b5b8939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae6c4a8-f79d-4278-ae63-8d94f4f68d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:25 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae6c4a8-f79d-4278-ae63-8d94f4f68d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a4b707-83cb-4f80-b7cb-4f068c29529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a4b707-83cb-4f80-b7cb-4f068c29529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62015219-04ab-4ddd-82f7-25773c70d9f5', 'volume_name': 'volume-62015219-04ab-4ddd-82f7-25773c70d9f5', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47868da7-b754-4692-894f-ac88b2d1c706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47868da7-b754-4692-894f-ac88b2d1c706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a990feaa-3b06-4bf1-87ae-10ea591918a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:25 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Volume 62015219-04ab-4ddd-82f7-25773c70d9f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62015219-04ab-4ddd-82f7-25773c70d9f5', 'volume_size': 1}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.958s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:25 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Deleted volume successfully.
Jul 06 15:47:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1ada7cd9-1ece-441e-bf2e-1edc818b9862 tempest-ProjectReaderTests-2035225243 None] Lock "cinder-9159452e-2f67-4619-b4f1-305cc5090fa3-delete_volume" released by "delete_volume" :: held 4.205s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:26 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" returned: 0 in 2.201s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:26 devstack sudo[104469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534
Jul 06 15:47:26 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:28 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534" returned: 0 in 1.875s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:28 devstack sudo[104474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534
Jul 06 15:47:28 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:28 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" returned: 0 in 5.855s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:28 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c000197-9515-4b82-88e4-cdc80114310a]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:28 devstack sudo[104476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b
Jul 06 15:47:28 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:29 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c.5ed55e59-91c2-4d69-befa-e90a59745534" returned: 0 in 1.011s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-5ed55e59-91c2-4d69-befa-e90a59745534" released by "_delete_snapshot" :: held 6.327s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" released by "delete_snapshot" :: held 6.375s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created reservations ['befccf4d-a2cb-452c-8eca-a8e717b5b3d7', '105eddf4-43fd-4472-9cdf-bfbb521899b1', '3f0b71b1-8dcf-44f6-afa1-f3cf2a907a0b', 'b1f2316c-f064-4cd8-be74-5f774fdbeaad'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=214,cinder:SELECT=144,cinder:DELETE=23,cinder:INSERT=48 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:47:29 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Delete snapshot completed successfully.
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f57e37e4-0e7e-422a-b4be-afbad265a551 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-5ed55e59-91c2-4d69-befa-e90a59745534-delete_snapshot" released by "delete_snapshot" :: held 6.594s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-fb2d9399-b634-4ea2-bcef-e03d8ca4666c-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-fb2d9399-b634-4ea2-bcef-e03d8ca4666c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "cinder-quobyte-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4219d895-7321-4bfb-8ad3-d2c97cc37e00]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:29 devstack sudo[104481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c
Jul 06 15:47:29 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:29 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b" returned: 0 in 1.045s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:47:29 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Converted 1024.00 MB image at 174.87 MB/s
Jul 06 15:47:29 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c is being set with open permissions: ugo+rw
Jul 06 15:47:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:29 devstack sudo[104484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c
Jul 06 15:47:29 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:30 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" returned: 0 in 0.821s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:30 devstack sudo[104491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c
Jul 06 15:47:30 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:30 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" returned: 0 in 0.689s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" released by "_copy_volume_from_snapshot" :: held 9.958s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-9e86e483-4cb0-4ef3-9462-550406afbded-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" released by "_create_volume_from_snapshot" :: held 10.023s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.077s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.445s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-585235848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62015219-04ab-4ddd-82f7-25773c70d9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22986b8c36a84778a805e9b9d2731ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:26Z,use_quota=True,user_id='256caa41a68d439988c200637b5b8939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Creating volume 62015219-04ab-4ddd-82f7-25773c70d9f5 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:30 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=160,cinder:UPDATE=217,cinder:INSERT=60,cinder:DELETE=17 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:47:30 devstack sudo[104493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5 1073741824
Jul 06 15:47:30 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa24cfd-cb90-4c8f-b1b4-44e99e896e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c', 'volume_size': 1, 'snapshot_id': '9e86e483-4cb0-4ef3-9462-550406afbded'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678be2bf-c76b-4a84-85e2-97870a75acd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:30 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Volume volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c (c2a21710-86e6-4839-ba1e-f9cbf89ae93c): created successfully
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678be2bf-c76b-4a84-85e2-97870a75acd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Flow 'volume_create_manager' (c3dd3b61-f0df-41fc-9cf8-38a14fd96699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:30 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ab29e8d0-721e-47b4-b37b-26d5296eddcb tempest-VolumeDependencyTests-566952354 None] Created volume successfully.
Jul 06 15:47:31 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" returned: 0 in 0.739s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-quobyte-fb2d9399-b634-4ea2-bcef-e03d8ca4666c" released by "delete_volume" :: held 1.636s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Created reservations ['f9e676ae-4be6-4e3b-9d40-9a204e399a95', '68a84bb4-c144-422e-99ca-c6679cc1b70e', '4b228720-4ac8-4ded-88c5-361368578619', 'dfc8adc6-696b-4ada-a2ec-ca60cd2391e3'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:31 devstack sudo[104499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:31 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:31 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5 1073741824" returned: 0 in 1.023s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "cinder-9e86e483-4cb0-4ef3-9462-550406afbded-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:31 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5
Jul 06 15:47:31 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-9e86e483-4cb0-4ef3-9462-550406afbded-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "cinder-quobyte-06a08cbd-d78f-4037-84ac-72459239296b" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-06a08cbd-d78f-4037-84ac-72459239296b" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "cinder-quobyte-9e86e483-4cb0-4ef3-9462-550406afbded" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-9e86e483-4cb0-4ef3-9462-550406afbded" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Deleting offline snapshot 9e86e483-4cb0-4ef3-9462-550406afbded of volume 06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] snapshot_file for this snap is: volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7ed709-7f10-43c8-a0ca-4c481bf6f839]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:31 devstack sudo[104503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded
Jul 06 15:47:31 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:31 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.768s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Deleted volume successfully.
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-942aefcd-4e4c-40d0-b525-b84cef4d42e2 tempest-CreateVolumesFromSnapshotTest-1938052451 None] Lock "cinder-fb2d9399-b634-4ea2-bcef-e03d8ca4666c-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:32 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5" returned: 0 in 0.854s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a990feaa-3b06-4bf1-87ae-10ea591918a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62015219-04ab-4ddd-82f7-25773c70d9f5', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da1718c-a0d5-4ddd-b1a5-3b906e5c958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:32 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Volume volume-62015219-04ab-4ddd-82f7-25773c70d9f5 (62015219-04ab-4ddd-82f7-25773c70d9f5): created successfully
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da1718c-a0d5-4ddd-b1a5-3b906e5c958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Flow 'volume_create_manager' (c60379c7-527f-4464-a580-d278ea6818dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d3cc9884-0063-45c7-8dae-a3bb2d9073cb tempest-ProjectReaderTests-2035225243 None] Created volume successfully.
Jul 06 15:47:32 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded" returned: 0 in 1.018s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a08cbd-d78f-4037-84ac-72459239296b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[197af2b1-846b-4438-ac23-dfaba5dd7777]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:32 devstack sudo[104510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b
Jul 06 15:47:32 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Acquiring lock "cinder-62015219-04ab-4ddd-82f7-25773c70d9f5-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Lock "cinder-62015219-04ab-4ddd-82f7-25773c70d9f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Acquiring lock "cinder-quobyte-62015219-04ab-4ddd-82f7-25773c70d9f5" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Lock "cinder-quobyte-62015219-04ab-4ddd-82f7-25773c70d9f5" acquired by "delete_volume" :: waited 0.029s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[47438a46-d3bc-44b1-ac0e-0afa27f1882f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:47:33 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:33 devstack sudo[104515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5
Jul 06 15:47:33 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (451b9fd4-5d6b-42ef-8c7e-e0fe94370eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1e0729-38eb-47d3-a041-4311907ef27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b" returned: 0 in 1.057s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1e0729-38eb-47d3-a041-4311907ef27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062783037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93da0b44-ec84-44fb-97cd-528d99f464f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:34Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:33 devstack sudo[104517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded
Jul 06 15:47:33 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005bf61b-14c6-44d5-b356-b1914cd3e0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005bf61b-14c6-44d5-b356-b1914cd3e0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0466c6b-28f3-4256-8a07-088c7b06d411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0466c6b-28f3-4256-8a07-088c7b06d411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93da0b44-ec84-44fb-97cd-528d99f464f3', 'volume_name': 'volume-93da0b44-ec84-44fb-97cd-528d99f464f3', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2055641d-5e2c-4602-a5f3-e34b580f2153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2055641d-5e2c-4602-a5f3-e34b580f2153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dc4941-a972-40f3-a434-e719d98d28bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:33 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Volume 93da0b44-ec84-44fb-97cd-528d99f464f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93da0b44-ec84-44fb-97cd-528d99f464f3', 'volume_size': 1}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062783037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93da0b44-ec84-44fb-97cd-528d99f464f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:34Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Creating volume 93da0b44-ec84-44fb-97cd-528d99f464f3 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:33 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:47:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:33 devstack sudo[104519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3 1073741824
Jul 06 15:47:33 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:34 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5" returned: 0 in 0.870s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:34 devstack sudo[104529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5
Jul 06 15:47:34 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:34 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded" returned: 0 in 0.891s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:34 devstack sudo[104532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded
Jul 06 15:47:34 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:34 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3 1073741824" returned: 0 in 0.994s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:34 devstack sudo[104534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3
Jul 06 15:47:34 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:35 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-62015219-04ab-4ddd-82f7-25773c70d9f5" returned: 0 in 0.776s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Lock "cinder-quobyte-62015219-04ab-4ddd-82f7-25773c70d9f5" released by "delete_volume" :: held 1.702s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Created reservations ['f1f9f555-af08-42fe-bc9d-9789f2b33ef6', '2f1a1b67-fec9-47a3-8d49-0ae5c55b31b9', '38be0db2-e753-4a12-8b99-371c03668c6f', '1d83e72d-4c0f-4775-bfac-df1eb7b6333e'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:35 devstack sudo[104538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:35 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:35 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b.9e86e483-4cb0-4ef3-9462-550406afbded" returned: 0 in 0.745s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-9e86e483-4cb0-4ef3-9462-550406afbded" released by "_delete_snapshot" :: held 3.832s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-06a08cbd-d78f-4037-84ac-72459239296b" released by "delete_snapshot" :: held 3.885s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Created reservations ['038ee4a2-1b91-43da-aeac-82f9642478a6', 'cb48b351-4130-419d-8ff7-5f6bc457572c', 'f61c0cf9-1e0e-4f06-b764-e737d013190d', '426d8069-7366-43e2-b559-aa186337463d'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:35 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Delete snapshot completed successfully.
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fd8c9ffe-c561-48cb-a5b3-6310cf339934 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-9e86e483-4cb0-4ef3-9462-550406afbded-delete_snapshot" released by "delete_snapshot" :: held 4.109s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:35 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3" returned: 0 in 0.928s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "cinder-06a08cbd-d78f-4037-84ac-72459239296b-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dc4941-a972-40f3-a434-e719d98d28bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93da0b44-ec84-44fb-97cd-528d99f464f3', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b64dee-bad3-4546-91f9-35411e6bb741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-06a08cbd-d78f-4037-84ac-72459239296b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:35 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Volume volume-93da0b44-ec84-44fb-97cd-528d99f464f3 (93da0b44-ec84-44fb-97cd-528d99f464f3): created successfully
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b64dee-bad3-4546-91f9-35411e6bb741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:35 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (451b9fd4-5d6b-42ef-8c7e-e0fe94370eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:35 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c2d962c4-b5e6-4196-8a77-7ff1c676e1ce tempest-ProjectMemberTests-1408538130 None] Created volume successfully.
Jul 06 15:47:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "cinder-quobyte-06a08cbd-d78f-4037-84ac-72459239296b" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-06a08cbd-d78f-4037-84ac-72459239296b" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:36 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b3ba39-253d-4b9b-a457-8d4474eb313b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:36 devstack sudo[104541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b
Jul 06 15:47:36 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:36 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.795s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:36 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Deleted volume successfully.
Jul 06 15:47:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f2b69317-d1ef-4710-be1f-6d8e7e27a508 tempest-ProjectReaderTests-2035225243 None] Lock "cinder-62015219-04ab-4ddd-82f7-25773c70d9f5-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b" returned: 0 in 0.879s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:36 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:36 devstack sudo[104547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b
Jul 06 15:47:36 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Creating offline snapshot 764dea7c-24da-448f-b29b-d910f7e58c24 of volume 93da0b44-ec84-44fb-97cd-528d99f464f3 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:47:37 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bdcbdb-9ba4-4f5e-b4cf-52716d8b84a7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:37 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-06a08cbd-d78f-4037-84ac-72459239296b" returned: 0 in 0.887s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:37 devstack sudo[104549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3
Jul 06 15:47:37 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-06a08cbd-d78f-4037-84ac-72459239296b" released by "delete_volume" :: held 1.844s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:37 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Created reservations ['3c0d2618-21df-48fb-b8cf-8fca74f5aaed', 'b1e34976-ba93-4c58-83dc-c83b2029178c', '52a574ab-c4de-4d7a-86f9-441260b152f2', '19e29dfb-d0e7-407c-b0ee-500aa0415ff8'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:38 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:38 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "cinder-c2a21710-86e6-4839-ba1e-f9cbf89ae93c-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-c2a21710-86e6-4839-ba1e-f9cbf89ae93c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "cinder-quobyte-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c2e655-cd5f-44f3-8a82-040e0ff9d1c9]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:38 devstack sudo[104554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c
Jul 06 15:47:38 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:38 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.757s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Deleted volume successfully.
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1763f1f9-7b80-458b-aeda-2345e70b0116 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-06a08cbd-d78f-4037-84ac-72459239296b-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:38 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3" returned: 0 in 1.239s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:38 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24 1G
Jul 06 15:47:38 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Flow 'volume_create_manager' (0ea635c9-176f-4e8b-9a8e-a3d6e8c5ca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5835347-65bb-4892-873c-2243a44c7590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5835347-65bb-4892-873c-2243a44c7590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00d7250-c7f9-4106-bc62-0e66c6c7fb2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41fa32d1d97400fa8009c0fb270b196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:39Z,use_quota=True,user_id='a3c5c79c341e489f942864844d48bc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540fd442-c7cb-4850-a41d-87d2e16f26c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540fd442-c7cb-4850-a41d-87d2e16f26c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f86050-1077-46a1-a018-cac94195d61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.image.glance [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Creating Keystone auth plugin from conf {{(pid=86249) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 15:47:39 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" returned: 0 in 1.066s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:39 devstack sudo[104565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c
Jul 06 15:47:39 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f86050-1077-46a1-a018-cac94195d61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd00d7250-c7f9-4106-bc62-0e66c6c7fb2f', 'volume_name': 'volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f', 'volume_size': 1, 'image_id': '8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '08c1f12e940514ee8190c2fd0f0f065f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f41fa32d1d97400fa8009c0fb270b196', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c0093752fa196c290b6be6413fe0eed9a2701aeda8defc16d0184f3c151f6dc291cdc8d91c5ab300f3c6f856d2f0080c86649a1385ebace3fb49325140a7654', 'id': '8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'created_at': datetime.datetime(2026, 7, 6, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 47, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8faf5ee7-6df4-41f1-8bb6-228911ac2357/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2beac20c0>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2f159e-11a4-4bea-aea8-4533a99794a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2f159e-11a4-4bea-aea8-4533a99794a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7e963c-9c0d-44a7-878d-f0ed14028a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:39 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Volume d00d7250-c7f9-4106-bc62-0e66c6c7fb2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f', 'volume_size': 1, 'image_id': '8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '08c1f12e940514ee8190c2fd0f0f065f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f41fa32d1d97400fa8009c0fb270b196', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c0093752fa196c290b6be6413fe0eed9a2701aeda8defc16d0184f3c151f6dc291cdc8d91c5ab300f3c6f856d2f0080c86649a1385ebace3fb49325140a7654', 'id': '8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'created_at': datetime.datetime(2026, 7, 6, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 47, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8faf5ee7-6df4-41f1-8bb6-228911ac2357/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2beac20c0>}
Jul 06 15:47:39 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Trying to clone d00d7250-c7f9-4106-bc62-0e66c6c7fb2f from image 8faf5ee7-6df4-41f1-8bb6-228911ac2357 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'metadata': {}}]). {{(pid=86249) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 15:47:40 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 15:47:40 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24 1G" returned: 0 in 1.162s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93da0b44-ec84-44fb-97cd-528d99f464f3 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9288f6-0d5d-4454-a4b6-2935d08d7711]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:40 devstack sudo[104571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93da0b44-ec84-44fb-97cd-528d99f464f3 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24
Jul 06 15:47:40 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:40 devstack sudo[104572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD
Jul 06 15:47:40 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:40 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" returned: 0 in 0.814s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-quobyte-c2a21710-86e6-4839-ba1e-f9cbf89ae93c" released by "delete_volume" :: held 1.942s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Created reservations ['67739b5d-bad0-4ef9-95e8-14d58957ca26', '972f4d2e-41a7-4ff8-8468-1d488fb9c4d8', '0aa3ffb9-5415-46fb-95e9-091f74ff8ab1', '11b76c8b-4e1f-4a49-bd8c-f8c281bef84b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:40 devstack sudo[104577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:40 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:41 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93da0b44-ec84-44fb-97cd-528d99f464f3 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24" returned: 0 in 1.070s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:41 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24 is being set with open permissions: ugo+rw
Jul 06 15:47:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:41 devstack sudo[104585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24
Jul 06 15:47:41 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:41 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD" returned: 0 in 1.112s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:41 devstack sudo[104587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD
Jul 06 15:47:41 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:41 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.056s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:41 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:41 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Deleted volume successfully.
Jul 06 15:47:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9f7de0f9-1409-4bb1-bf1b-1201f69bc658 tempest-VolumeDependencyTests-566952354 None] Lock "cinder-c2a21710-86e6-4839-ba1e-f9cbf89ae93c-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:42 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24" returned: 0 in 1.003s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:42 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD" returned: 1 in 1.026s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:47:42 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Temporary image 8faf5ee7-6df4-41f1-8bb6-228911ac2357 is fetched for user a3c5c79c341e489f942864844d48bc6e. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 15:47:42 devstack sudo[104594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.info
Jul 06 15:47:42 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:42 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b0eed7-47cc-4f79-b7a2-7ca92ce0b41e]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:42 devstack sudo[104596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD
Jul 06 15:47:42 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:43 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.info" returned: 0 in 0.869s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:43 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.info is being set with open permissions: ugo+rw
Jul 06 15:47:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:43 devstack sudo[104599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.info
Jul 06 15:47:43 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:43 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD" returned: 0 in 0.977s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:43 devstack sudo[104603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD
Jul 06 15:47:43 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:43 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.info" returned: 0 in 0.768s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.277s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:43 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8c600acd-ca4d-4876-a281-edcc69e07b2c tempest-ProjectMemberTests-1408538130 None] Create snapshot completed successfully
Jul 06 15:47:44 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD" returned: 1 in 0.947s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00d7250-c7f9-4106-bc62-0e66c6c7fb2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41fa32d1d97400fa8009c0fb270b196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:39Z,use_quota=True,user_id='a3c5c79c341e489f942864844d48bc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Creating volume d00d7250-c7f9-4106-bc62-0e66c6c7fb2f {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:44 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:44 devstack sudo[104609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f 1073741824
Jul 06 15:47:44 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-764dea7c-24da-448f-b29b-d910f7e58c24-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-764dea7c-24da-448f-b29b-d910f7e58c24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-93da0b44-ec84-44fb-97cd-528d99f464f3" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-93da0b44-ec84-44fb-97cd-528d99f464f3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-764dea7c-24da-448f-b29b-d910f7e58c24" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-764dea7c-24da-448f-b29b-d910f7e58c24" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Deleting offline snapshot 764dea7c-24da-448f-b29b-d910f7e58c24 of volume 93da0b44-ec84-44fb-97cd-528d99f464f3 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] snapshot_file for this snap is: volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a196c7da-6d15-40e8-835f-4cdb24e2463c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:45 devstack sudo[104615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24
Jul 06 15:47:45 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:45 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f 1073741824" returned: 0 in 0.996s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:45 devstack sudo[104617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f
Jul 06 15:47:45 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:45 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24" returned: 0 in 0.869s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93da0b44-ec84-44fb-97cd-528d99f464f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:47:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f96160-ed61-47d6-b6a3-2aa99d0aa4b5]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:46 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f" returned: 0 in 0.796s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:46 devstack sudo[104623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3
Jul 06 15:47:46 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:46 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Attempting download of 8faf5ee7-6df4-41f1-8bb6-228911ac2357 ((None, [{'url': 'file:///opt/stack/data/glance/images/8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'metadata': {}}])) to volume d00d7250-c7f9-4106-bc62-0e66c6c7fb2f. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 15:47:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be41d58-19fb-4109-9ea4-f31feeefc55c]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8faf5ee7-6df4-41f1-8bb6-228911ac2357_j2syyd2v {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:46 devstack sudo[104625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8faf5ee7-6df4-41f1-8bb6-228911ac2357_j2syyd2v
Jul 06 15:47:46 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:47 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3" returned: 0 in 1.058s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:47 devstack sudo[104632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24
Jul 06 15:47:47 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:47 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8faf5ee7-6df4-41f1-8bb6-228911ac2357_j2syyd2v" returned: 0 in 1.069s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8faf5ee7-6df4-41f1-8bb6-228911ac2357_j2syyd2v {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:47 devstack sudo[104636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8faf5ee7-6df4-41f1-8bb6-228911ac2357_j2syyd2v
Jul 06 15:47:47 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:47 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24" returned: 0 in 0.898s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:47 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24
Jul 06 15:47:47 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:48 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8faf5ee7-6df4-41f1-8bb6-228911ac2357_j2syyd2v" returned: 1 in 0.795s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8faf5ee7-6df4-41f1-8bb6-228911ac2357_j2syyd2v' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:47:48 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1ead4a-3f12-432f-90ca-650398235cd6]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:48 devstack sudo[104646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD
Jul 06 15:47:48 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:48 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3.764dea7c-24da-448f-b29b-d910f7e58c24" returned: 0 in 0.873s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-764dea7c-24da-448f-b29b-d910f7e58c24" released by "_delete_snapshot" :: held 3.834s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-93da0b44-ec84-44fb-97cd-528d99f464f3" released by "delete_snapshot" :: held 3.873s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:48 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Created reservations ['dd1118dd-7d4e-44be-92e7-8bbcd8216059', 'bc1cd75b-27c1-4596-8a02-f3b0d61b191f', 'da0fb46b-3d93-4e7d-b95a-6d3c70553a75', '5dcf019a-af67-46c7-902f-3154005e9b8e'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:49 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD" returned: 0 in 0.913s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:49 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Delete snapshot completed successfully.
Jul 06 15:47:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-725acffe-d8f2-4bd6-b34a-e73d13d4b994 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-764dea7c-24da-448f-b29b-d910f7e58c24-delete_snapshot" released by "delete_snapshot" :: held 4.078s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:49 devstack sudo[104651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD
Jul 06 15:47:49 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-93da0b44-ec84-44fb-97cd-528d99f464f3-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-93da0b44-ec84-44fb-97cd-528d99f464f3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-93da0b44-ec84-44fb-97cd-528d99f464f3" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-93da0b44-ec84-44fb-97cd-528d99f464f3" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:49 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[58310659-49fb-46fd-b529-2939f60c4781]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:49 devstack sudo[104653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3
Jul 06 15:47:49 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:50 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD" returned: 1 in 0.975s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:47:50 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] 8faf5ee7-6df4-41f1-8bb6-228911ac2357 was raw, converting to raw {{(pid=86249) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 15:47:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:50 devstack sudo[104658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f
Jul 06 15:47:50 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:50 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3" returned: 0 in 0.805s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:50 devstack sudo[104664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3
Jul 06 15:47:50 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:51 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f" returned: 0 in 1.044s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8faf5ee7-6df4-41f1-8bb6-228911ac2357_st6peimsdevstack@QuobyteHD, size 0.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:47:51 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:51 devstack sudo[104669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f 1G
Jul 06 15:47:51 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:51 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-93da0b44-ec84-44fb-97cd-528d99f464f3" returned: 0 in 1.076s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-93da0b44-ec84-44fb-97cd-528d99f464f3" released by "delete_volume" :: held 1.957s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Created reservations ['ccb44f5f-e43a-40a7-b70e-fd4fca7f41fd', '877b7e0f-4c03-4c3f-b3bf-b6635b9ef8b3', 'bf9b85c6-f6ee-4a24-be61-617d9f34d8de', '26d50e01-2275-49e6-8123-4791ded50b53'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:51 devstack sudo[104672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:51 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:52 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f 1G" returned: 0 in 1.201s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20545de-3ff7-42ee-88bd-d989109a0951]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (e8210787-b0e7-427b-acfb-734c2d265b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:52 devstack sudo[104677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f
Jul 06 15:47:52 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c68a83-2e02-4277-89e5-0d2b37c314eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:52 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c68a83-2e02-4277-89e5-0d2b37c314eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723132591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4209124-d619-4128-b89a-2cae9f4173b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:52Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675d455d-c010-4aa1-8ce4-cbfa60e7d83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675d455d-c010-4aa1-8ce4-cbfa60e7d83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12300466-e733-418a-bce4-07a2de8c4faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12300466-e733-418a-bce4-07a2de8c4faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4209124-d619-4128-b89a-2cae9f4173b8', 'volume_name': 'volume-c4209124-d619-4128-b89a-2cae9f4173b8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebda2838-a137-4f51-abe4-fbdcff7121d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebda2838-a137-4f51-abe4-fbdcff7121d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839a39d9-f961-43d9-a06c-550bd333c74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Volume c4209124-d619-4128-b89a-2cae9f4173b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4209124-d619-4128-b89a-2cae9f4173b8', 'volume_size': 1}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723132591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4209124-d619-4128-b89a-2cae9f4173b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:52Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Creating volume c4209124-d619-4128-b89a-2cae9f4173b8 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:47:52 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 1.115s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:47:52 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Deleted volume successfully.
Jul 06 15:47:52 devstack sudo[104680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8 1073741824
Jul 06 15:47:52 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f6e6a373-c9af-45f9-931e-441b50f5ded9 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-93da0b44-ec84-44fb-97cd-528d99f464f3-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:53 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f" returned: 0 in 1.141s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:53 devstack sudo[104687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f
Jul 06 15:47:53 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:53 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8 1073741824" returned: 0 in 1.154s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:53 devstack sudo[104690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8
Jul 06 15:47:53 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:54 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f" returned: 1 in 0.964s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Downloaded image 8faf5ee7-6df4-41f1-8bb6-228911ac2357 ((None, [{'url': 'file:///opt/stack/data/glance/images/8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'metadata': {}}])) to volume d00d7250-c7f9-4106-bc62-0e66c6c7fb2f successfully. {{(pid=86249) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Temporary image 8faf5ee7-6df4-41f1-8bb6-228911ac2357 for user a3c5c79c341e489f942864844d48bc6e is deleted. {{(pid=86249) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG cinder.volume.volume_utils [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Marking volume d00d7250-c7f9-4106-bc62-0e66c6c7fb2f as bootable. {{(pid=86249) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Copying metadata from image 8faf5ee7-6df4-41f1-8bb6-228911ac2357 to d00d7250-c7f9-4106-bc62-0e66c6c7fb2f. {{(pid=86249) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Creating volume glance metadata for volume d00d7250-c7f9-4106-bc62-0e66c6c7fb2f backed by image 8faf5ee7-6df4-41f1-8bb6-228911ac2357 with: {'image_id': '8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '08c1f12e940514ee8190c2fd0f0f065f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86249) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7e963c-9c0d-44a7-878d-f0ed14028a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f', 'volume_size': 1, 'image_id': '8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '08c1f12e940514ee8190c2fd0f0f065f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f41fa32d1d97400fa8009c0fb270b196', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c0093752fa196c290b6be6413fe0eed9a2701aeda8defc16d0184f3c151f6dc291cdc8d91c5ab300f3c6f856d2f0080c86649a1385ebace3fb49325140a7654', 'id': '8faf5ee7-6df4-41f1-8bb6-228911ac2357', 'created_at': datetime.datetime(2026, 7, 6, 13, 47, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 47, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8faf5ee7-6df4-41f1-8bb6-228911ac2357/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78b2beac20c0>}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e97049-965d-4b45-8101-74f2b1070426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:54 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Volume volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f (d00d7250-c7f9-4106-bc62-0e66c6c7fb2f): created successfully
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e97049-965d-4b45-8101-74f2b1070426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Flow 'volume_create_manager' (0ea635c9-176f-4e8b-9a8e-a3d6e8c5ca40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:54 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c6cb4811-4065-4fc3-9c45-534a0f6b78fa tempest-VolumeImageDependencyTests-812233879 None] Created volume successfully.
Jul 06 15:47:54 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8" returned: 0 in 1.031s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:47:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.271s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839a39d9-f961-43d9-a06c-550bd333c74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4209124-d619-4128-b89a-2cae9f4173b8', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c34736-3842-4980-b473-7530744b26a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:47:55 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Volume volume-c4209124-d619-4128-b89a-2cae9f4173b8 (c4209124-d619-4128-b89a-2cae9f4173b8): created successfully
Jul 06 15:47:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c34736-3842-4980-b473-7530744b26a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:47:55 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (e8210787-b0e7-427b-acfb-734c2d265b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:47:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f42e6c27-bac3-4a75-8456-fbbf8e44b978 tempest-ProjectMemberTests-1408538130 None] Created volume successfully.
Jul 06 15:47:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Acquiring lock "cinder-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Lock "cinder-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Acquiring lock "cinder-quobyte-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:47:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Lock "cinder-quobyte-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f" acquired by "delete_volume" :: waited 0.033s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:47:56 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbefc10-ec42-455d-b42e-36bcd4b7667b]: (4, 'raw') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Creating offline snapshot cb636c2c-58fc-4c0d-92b4-53fbda8bea67 of volume c4209124-d619-4128-b89a-2cae9f4173b8 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:47:56 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb4c33e-da7f-4373-bfe4-590498e793f0]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:47:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:56 devstack sudo[104697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f
Jul 06 15:47:56 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:56 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8
Jul 06 15:47:56 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:57 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f" returned: 0 in 1.056s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:57 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8" returned: 0 in 0.999s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:57 devstack sudo[104708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67 1G
Jul 06 15:47:57 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:57 devstack sudo[104707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f
Jul 06 15:47:57 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:58 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f" returned: 1 in 1.084s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f' failed. Not Retrying. {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 15:47:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:58 devstack sudo[104718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f
Jul 06 15:47:58 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:58 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67 1G" returned: 0 in 1.306s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4209124-d619-4128-b89a-2cae9f4173b8 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:58 devstack sudo[104720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4209124-d619-4128-b89a-2cae9f4173b8 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67
Jul 06 15:47:58 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:59 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f" returned: 0 in 0.944s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Lock "cinder-quobyte-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f" released by "delete_volume" :: held 3.245s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Created reservations ['8e57c89e-af1c-4abc-9ac6-c3ee11cf239e', '7419347a-c332-4392-82a9-669790a05109', 'b8b9c9fe-7c9b-4ab4-a898-81b7739e210d', '670b8d8e-d254-4c3e-bc9a-2587057e5b2f'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:59 devstack sudo[104730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:47:59 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:47:59 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4209124-d619-4128-b89a-2cae9f4173b8 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67" returned: 0 in 1.159s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:47:59 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67 is being set with open permissions: ugo+rw
Jul 06 15:47:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:47:59 devstack sudo[104732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67
Jul 06 15:47:59 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:00 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.818s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:00 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:48:00 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Deleted volume successfully.
Jul 06 15:48:00 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-9919b322-fd29-4172-b916-62b7edc8d639 tempest-VolumeImageDependencyTests-812233879 None] Lock "cinder-d00d7250-c7f9-4106-bc62-0e66c6c7fb2f-delete_volume" released by "delete_volume" :: held 4.382s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:00 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67" returned: 0 in 0.884s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:00 devstack sudo[104737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.info
Jul 06 15:48:00 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:01 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.info" returned: 0 in 0.772s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:01 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.info is being set with open permissions: ugo+rw
Jul 06 15:48:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:01 devstack sudo[104740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.info
Jul 06 15:48:01 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:02 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.info" returned: 0 in 0.831s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.088s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:02 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-79bf3295-bcfc-4b1f-87e4-1c8d90bcc977 tempest-ProjectMemberTests-1408538130 None] Create snapshot completed successfully
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-cb636c2c-58fc-4c0d-92b4-53fbda8bea67-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-cb636c2c-58fc-4c0d-92b4-53fbda8bea67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-c4209124-d619-4128-b89a-2cae9f4173b8" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-c4209124-d619-4128-b89a-2cae9f4173b8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-cb636c2c-58fc-4c0d-92b4-53fbda8bea67" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-cb636c2c-58fc-4c0d-92b4-53fbda8bea67" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Deleting offline snapshot cb636c2c-58fc-4c0d-92b4-53fbda8bea67 of volume c4209124-d619-4128-b89a-2cae9f4173b8 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] snapshot_file for this snap is: volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcb3ead-344d-4586-bed2-63bd2febd90c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:02 devstack sudo[104743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67
Jul 06 15:48:02 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:03 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67" returned: 0 in 0.778s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4209124-d619-4128-b89a-2cae9f4173b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:48:03 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[875bae0f-a12f-478b-9686-3b92fe5f34d4]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:03 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8
Jul 06 15:48:03 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Flow 'volume_create_manager' (57a282c6-00dc-4b5b-9f67-a626c82bbd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92286d8-6ba8-42f1-9021-9a5abdc28616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92286d8-6ba8-42f1-9021-9a5abdc28616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4dca53e-00de-4c9f-8fb6-df7c78b7c585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e377f06974496b9d5768efa1e59ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:04Z,use_quota=True,user_id='24919cd2e8ef4893a3d55aaa0902e099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78780e4e-343f-472d-9f74-0d1e95dd3e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78780e4e-343f-472d-9f74-0d1e95dd3e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c12620-f1dc-4ad6-aec6-f48ab4867915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c12620-f1dc-4ad6-aec6-f48ab4867915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4dca53e-00de-4c9f-8fb6-df7c78b7c585', 'volume_name': 'volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc357a05-6293-4640-91c1-eb7424d95f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc357a05-6293-4640-91c1-eb7424d95f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a33162c-06cd-4c7f-9203-baa0abced88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:04 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Volume d4dca53e-00de-4c9f-8fb6-df7c78b7c585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585', 'volume_size': 1}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4dca53e-00de-4c9f-8fb6-df7c78b7c585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e377f06974496b9d5768efa1e59ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:04Z,use_quota=True,user_id='24919cd2e8ef4893a3d55aaa0902e099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Creating volume d4dca53e-00de-4c9f-8fb6-df7c78b7c585 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:48:04 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:04 devstack sudo[104753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585 1073741824
Jul 06 15:48:04 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:04 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8" returned: 0 in 0.953s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:04 devstack sudo[104755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67
Jul 06 15:48:04 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:05 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67" returned: 0 in 1.011s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:05 devstack sudo[104764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67
Jul 06 15:48:05 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:05 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585 1073741824" returned: 0 in 1.318s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:05 devstack sudo[104767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585
Jul 06 15:48:05 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:06 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8.cb636c2c-58fc-4c0d-92b4-53fbda8bea67" returned: 0 in 0.690s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-cb636c2c-58fc-4c0d-92b4-53fbda8bea67" released by "_delete_snapshot" :: held 3.574s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-c4209124-d619-4128-b89a-2cae9f4173b8" released by "delete_snapshot" :: held 3.611s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Created reservations ['defc932d-b9b4-49f6-a252-59e288740c11', '311d0e39-d610-45c7-a914-b77197bf1e65', 'fcafaeb9-51bc-46f4-8561-15bdb5391964', '22e740f0-7966-469b-8218-9bf6f68ceec5'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:06 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Delete snapshot completed successfully.
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e79c4100-d025-426a-bcac-e8e9f7d04725 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-cb636c2c-58fc-4c0d-92b4-53fbda8bea67-delete_snapshot" released by "delete_snapshot" :: held 3.843s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:06 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585" returned: 0 in 0.780s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a33162c-06cd-4c7f-9203-baa0abced88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf479c8-750b-4d27-9d0d-9e463da2b7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:06 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Volume volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585 (d4dca53e-00de-4c9f-8fb6-df7c78b7c585): created successfully
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf479c8-750b-4d27-9d0d-9e463da2b7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Flow 'volume_create_manager' (57a282c6-00dc-4b5b-9f67-a626c82bbd24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:06 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a89d57fb-a148-423e-a66b-d0897de51c54 tempest-CinderUnicodeTest-1058737351 None] Created volume successfully.
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:06 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:48:06 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-c4209124-d619-4128-b89a-2cae9f4173b8-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-c4209124-d619-4128-b89a-2cae9f4173b8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-c4209124-d619-4128-b89a-2cae9f4173b8" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-c4209124-d619-4128-b89a-2cae9f4173b8" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:07 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfa7e27-ebff-47f5-953c-b99f1dc4c01b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:07 devstack sudo[104774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8
Jul 06 15:48:07 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:07 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.827s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:48:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:48:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:48:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:48:08 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Flow 'volume_create_manager' (027ba780-0cda-404b-a5bc-23d0f70263ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b5853a-810c-4d34-9a63-66cea4381bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8" returned: 0 in 1.139s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b5853a-810c-4d34-9a63-66cea4381bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-348174856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160ddbaf-1de3-4c33-8427-73e951b95e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e377f06974496b9d5768efa1e59ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:08Z,use_quota=True,user_id='24919cd2e8ef4893a3d55aaa0902e099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:08 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8
Jul 06 15:48:08 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdb4fd8-0bff-4074-bfec-ed44ba96120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdb4fd8-0bff-4074-bfec-ed44ba96120a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49badc92-bad7-4bcc-b292-eccc56d92df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49badc92-bad7-4bcc-b292-eccc56d92df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '160ddbaf-1de3-4c33-8427-73e951b95e0c', 'volume_name': 'volume-160ddbaf-1de3-4c33-8427-73e951b95e0c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95717ff-dc93-4ad2-898a-b8ca5b5d7884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95717ff-dc93-4ad2-898a-b8ca5b5d7884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7ae381-86b6-4e03-bf76-7d2d10fd6b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:08 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Volume 160ddbaf-1de3-4c33-8427-73e951b95e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-160ddbaf-1de3-4c33-8427-73e951b95e0c', 'volume_size': 1}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-348174856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160ddbaf-1de3-4c33-8427-73e951b95e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e377f06974496b9d5768efa1e59ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:08Z,use_quota=True,user_id='24919cd2e8ef4893a3d55aaa0902e099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Creating volume 160ddbaf-1de3-4c33-8427-73e951b95e0c {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:48:08 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:48:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:08 devstack sudo[104783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c 1073741824
Jul 06 15:48:08 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:08 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c4209124-d619-4128-b89a-2cae9f4173b8" returned: 0 in 0.730s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-c4209124-d619-4128-b89a-2cae9f4173b8" released by "delete_volume" :: held 1.940s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Created reservations ['c3bc084c-df67-413c-a23d-c255fb094ce6', 'a67e9ec5-1264-4985-ac65-188e02683dde', '7b49bfdd-fa7e-4d45-b219-a3275f34a8ad', '56b23dd3-65a9-400f-8a8e-4b91fda93ca4'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:09 devstack sudo[104790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:48:09 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:09 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c 1073741824" returned: 0 in 1.014s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:09 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c
Jul 06 15:48:09 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (6e0eff45-f836-48bf-ab6f-ffb6cf89e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3080ecbf-0ba1-42a0-bf1a-99d0e8b0dbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3080ecbf-0ba1-42a0-bf1a-99d0e8b0dbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624123235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cb3a65-6d9e-43ba-b842-d7448281e515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:10Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1276a122-25d4-405a-9ec2-8a47da54f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1276a122-25d4-405a-9ec2-8a47da54f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:09 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfd8be1-e9d6-481d-91e7-a437895a6c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfd8be1-e9d6-481d-91e7-a437895a6c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51cb3a65-6d9e-43ba-b842-d7448281e515', 'volume_name': 'volume-51cb3a65-6d9e-43ba-b842-d7448281e515', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c9bb60-5a4f-4f30-bf15-7f941458c2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c9bb60-5a4f-4f30-bf15-7f941458c2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39381e06-a811-4781-bb66-fe5dfcabf87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:10 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Volume 51cb3a65-6d9e-43ba-b842-d7448281e515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51cb3a65-6d9e-43ba-b842-d7448281e515', 'volume_size': 1}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:10 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.904s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:48:10 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Deleted volume successfully.
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-24a8e2b8-0270-4d5c-9d08-acbe3e69c691 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-c4209124-d619-4128-b89a-2cae9f4173b8-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:10 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c" returned: 0 in 1.045s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.416s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624123235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cb3a65-6d9e-43ba-b842-d7448281e515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:10Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Creating volume 51cb3a65-6d9e-43ba-b842-d7448281e515 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:48:10 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:10 devstack sudo[104799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515 1073741824
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7ae381-86b6-4e03-bf76-7d2d10fd6b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-160ddbaf-1de3-4c33-8427-73e951b95e0c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:10 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe224ef-ca18-4f27-b62a-1dbd4be1b34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:10 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Volume volume-160ddbaf-1de3-4c33-8427-73e951b95e0c (160ddbaf-1de3-4c33-8427-73e951b95e0c): created successfully
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe224ef-ca18-4f27-b62a-1dbd4be1b34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Flow 'volume_create_manager' (027ba780-0cda-404b-a5bc-23d0f70263ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:10 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fe00b68a-8129-4d58-8461-f63554437b87 tempest-CinderUnicodeTest-1058737351 None] Created volume successfully.
Jul 06 15:48:11 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515 1073741824" returned: 0 in 0.880s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:11 devstack sudo[104805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515
Jul 06 15:48:11 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Flow 'volume_create_manager' (c90301a3-d267-4c42-9697-576237ec3151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a82372-c4d6-4d59-81c8-58fa0978f746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a82372-c4d6-4d59-81c8-58fa0978f746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1421546609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743bc6a9-f0ff-4e94-890e-911d28019f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceab94e278e54f519ccc5ef9ed7e77d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:11Z,use_quota=True,user_id='676d0f0f193f4a79b20af8578d3173f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b037583-5c09-46dc-87a6-b65a60635feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b037583-5c09-46dc-87a6-b65a60635feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605c9299-6656-445f-aabd-8bcf789a3d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605c9299-6656-445f-aabd-8bcf789a3d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743bc6a9-f0ff-4e94-890e-911d28019f7c', 'volume_name': 'volume-743bc6a9-f0ff-4e94-890e-911d28019f7c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc9fa40-7c23-4c36-9895-2186a0b42733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc9fa40-7c23-4c36-9895-2186a0b42733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370c2dde-22c3-4c50-be3e-bfca112ea4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:11 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Volume 743bc6a9-f0ff-4e94-890e-911d28019f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743bc6a9-f0ff-4e94-890e-911d28019f7c', 'volume_size': 1}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:12 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515" returned: 0 in 0.745s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1421546609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743bc6a9-f0ff-4e94-890e-911d28019f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceab94e278e54f519ccc5ef9ed7e77d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:11Z,use_quota=True,user_id='676d0f0f193f4a79b20af8578d3173f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Creating volume 743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:48:12 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39381e06-a811-4781-bb66-fe5dfcabf87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51cb3a65-6d9e-43ba-b842-d7448281e515', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773b5961-dc64-441c-8684-59e31c6eb3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:12 devstack sudo[104808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c 1073741824
Jul 06 15:48:12 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:12 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Volume volume-51cb3a65-6d9e-43ba-b842-d7448281e515 (51cb3a65-6d9e-43ba-b842-d7448281e515): created successfully
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773b5961-dc64-441c-8684-59e31c6eb3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:12 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (6e0eff45-f836-48bf-ab6f-ffb6cf89e393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c82bbe04-95a0-4333-9366-638561220de3 tempest-ProjectMemberTests-1408538130 None] Created volume successfully.
Jul 06 15:48:13 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c 1073741824" returned: 0 in 0.865s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:13 devstack sudo[104814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c
Jul 06 15:48:13 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:13 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c" returned: 0 in 0.653s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.973s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370c2dde-22c3-4c50-be3e-bfca112ea4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743bc6a9-f0ff-4e94-890e-911d28019f7c', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fa733c-820d-451f-863f-d7b04b30e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Creating offline snapshot 49ca6d82-a099-4e90-964d-98ff6b4257a6 of volume 160ddbaf-1de3-4c33-8427-73e951b95e0c {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:48:13 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Volume volume-743bc6a9-f0ff-4e94-890e-911d28019f7c (743bc6a9-f0ff-4e94-890e-911d28019f7c): created successfully
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fa733c-820d-451f-863f-d7b04b30e55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Flow 'volume_create_manager' (c90301a3-d267-4c42-9697-576237ec3151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5c5cd0-fd1e-4a79-861f-c0d2e59c8d2a]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:13 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-491f3d8a-d3ba-4b89-ad2e-652e3f9ed361 tempest-SnapshotDependencyTests-815217484 None] Created volume successfully.
Jul 06 15:48:13 devstack sudo[104817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c
Jul 06 15:48:13 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:14 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c" returned: 0 in 0.752s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:14 devstack sudo[104822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6 1G
Jul 06 15:48:14 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:15 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6 1G" returned: 0 in 0.810s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-160ddbaf-1de3-4c33-8427-73e951b95e0c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:15 devstack sudo[104827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-160ddbaf-1de3-4c33-8427-73e951b95e0c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6
Jul 06 15:48:15 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:16 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-160ddbaf-1de3-4c33-8427-73e951b95e0c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6" returned: 0 in 0.746s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:16 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6 is being set with open permissions: ugo+rw
Jul 06 15:48:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:16 devstack sudo[104833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6
Jul 06 15:48:16 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:16 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6" returned: 0 in 0.643s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:16 devstack sudo[104872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.info
Jul 06 15:48:16 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:17 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.info" returned: 0 in 0.642s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:17 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.info is being set with open permissions: ugo+rw
Jul 06 15:48:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:17 devstack sudo[104875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.info
Jul 06 15:48:17 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:18 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.info" returned: 0 in 0.624s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.326s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.876s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Creating offline snapshot 23ec7279-429d-4251-b03d-ac9864bf58f2 of volume 51cb3a65-6d9e-43ba-b842-d7448281e515 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:48:18 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ae8da532-986d-402e-b0f6-ca2ac1cbae8c tempest-CinderUnicodeTest-1058737351 None] Create snapshot completed successfully
Jul 06 15:48:18 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0cdd13-012b-4757-8ea3-202df85f311c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:18 devstack sudo[104878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515
Jul 06 15:48:18 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:18 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515" returned: 0 in 0.717s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:18 devstack sudo[104883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2 1G
Jul 06 15:48:18 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "cinder-49ca6d82-a099-4e90-964d-98ff6b4257a6-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-49ca6d82-a099-4e90-964d-98ff6b4257a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "cinder-quobyte-160ddbaf-1de3-4c33-8427-73e951b95e0c" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-quobyte-160ddbaf-1de3-4c33-8427-73e951b95e0c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "cinder-quobyte-49ca6d82-a099-4e90-964d-98ff6b4257a6" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-quobyte-49ca6d82-a099-4e90-964d-98ff6b4257a6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Deleting offline snapshot 49ca6d82-a099-4e90-964d-98ff6b4257a6 of volume 160ddbaf-1de3-4c33-8427-73e951b95e0c {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] snapshot_file for this snap is: volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf79d69-2be8-4391-8348-b2073fa886c0]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:19 devstack sudo[104885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6
Jul 06 15:48:19 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:19 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2 1G" returned: 0 in 0.862s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51cb3a65-6d9e-43ba-b842-d7448281e515 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:19 devstack sudo[104890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51cb3a65-6d9e-43ba-b842-d7448281e515 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2
Jul 06 15:48:19 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:20 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6" returned: 0 in 0.783s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:20 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-160ddbaf-1de3-4c33-8427-73e951b95e0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:48:20 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a380d16-d7ab-415f-9775-bc3e09627b94]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:20 devstack sudo[104895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c
Jul 06 15:48:20 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:20 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51cb3a65-6d9e-43ba-b842-d7448281e515 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2" returned: 0 in 0.710s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:20 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2 is being set with open permissions: ugo+rw
Jul 06 15:48:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:20 devstack sudo[104901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2
Jul 06 15:48:20 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:20 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c" returned: 0 in 0.863s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:20 devstack sudo[104906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6
Jul 06 15:48:20 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:21 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2" returned: 0 in 0.736s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:21 devstack sudo[104909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.info
Jul 06 15:48:21 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:21 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6" returned: 0 in 0.835s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:21 devstack sudo[104915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6
Jul 06 15:48:21 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:21 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.info" returned: 0 in 0.676s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:21 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.info is being set with open permissions: ugo+rw
Jul 06 15:48:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:21 devstack sudo[104917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.info
Jul 06 15:48:21 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:22 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.info" returned: 0 in 0.634s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:22 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.435s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.572s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c.49ca6d82-a099-4e90-964d-98ff6b4257a6" returned: 0 in 0.738s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Creating offline snapshot c568e662-f95f-4cf0-99d9-269f00f418cc of volume 743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[82805bb3-fa9b-47af-8cee-b8d3f826ff79]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-26f75282-2b96-4906-bba0-661b05cd01b7 tempest-ProjectMemberTests-1408538130 None] Create snapshot completed successfully
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-quobyte-49ca6d82-a099-4e90-964d-98ff6b4257a6" released by "_delete_snapshot" :: held 3.374s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-quobyte-160ddbaf-1de3-4c33-8427-73e951b95e0c" released by "delete_snapshot" :: held 3.405s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Created reservations ['ac7293c7-463c-4aae-9624-407940358d44', '7e0c5924-580c-4785-90d1-a74e700db4df', 'b095fa27-3d7e-4a84-a54d-841239467515', '75b263f2-6528-43a2-bf92-1fbde9627772'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:22 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c
Jul 06 15:48:22 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Delete snapshot completed successfully.
Jul 06 15:48:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3a40f1f5-7857-45d9-b460-c410cc28b272 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-49ca6d82-a099-4e90-964d-98ff6b4257a6-delete_snapshot" released by "delete_snapshot" :: held 3.572s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "cinder-160ddbaf-1de3-4c33-8427-73e951b95e0c-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:23 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c" returned: 0 in 0.846s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-160ddbaf-1de3-4c33-8427-73e951b95e0c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:23 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc 1G
Jul 06 15:48:23 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "cinder-quobyte-160ddbaf-1de3-4c33-8427-73e951b95e0c" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-quobyte-160ddbaf-1de3-4c33-8427-73e951b95e0c" acquired by "delete_volume" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f534e1-26f9-458a-9579-bb484cdf23b8]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-23ec7279-429d-4251-b03d-ac9864bf58f2-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-23ec7279-429d-4251-b03d-ac9864bf58f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-51cb3a65-6d9e-43ba-b842-d7448281e515" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-51cb3a65-6d9e-43ba-b842-d7448281e515" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-23ec7279-429d-4251-b03d-ac9864bf58f2" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-23ec7279-429d-4251-b03d-ac9864bf58f2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Deleting offline snapshot 23ec7279-429d-4251-b03d-ac9864bf58f2 of volume 51cb3a65-6d9e-43ba-b842-d7448281e515 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] snapshot_file for this snap is: volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:48:23 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c
Jul 06 15:48:23 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[52536a5c-d321-4f44-a6b8-46e5d5deee1d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:23 devstack sudo[104930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2
Jul 06 15:48:23 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:24 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc 1G" returned: 0 in 0.901s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743bc6a9-f0ff-4e94-890e-911d28019f7c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:24 devstack sudo[104939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743bc6a9-f0ff-4e94-890e-911d28019f7c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc
Jul 06 15:48:24 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:24 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c" returned: 0 in 0.924s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:24 devstack sudo[104950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c
Jul 06 15:48:24 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:24 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2" returned: 0 in 0.893s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51cb3a65-6d9e-43ba-b842-d7448281e515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:48:24 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad85b9c-cf67-430a-b683-e1f9c830d8f7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:24 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515
Jul 06 15:48:24 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:25 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743bc6a9-f0ff-4e94-890e-911d28019f7c -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc" returned: 0 in 0.842s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:25 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc is being set with open permissions: ugo+rw
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:25 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc
Jul 06 15:48:25 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:25 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-160ddbaf-1de3-4c33-8427-73e951b95e0c" returned: 0 in 0.741s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-quobyte-160ddbaf-1de3-4c33-8427-73e951b95e0c" released by "delete_volume" :: held 1.744s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Created reservations ['41576179-4b4b-4de8-9d07-5ac926b965c8', 'ccde264b-147e-48ed-b0e4-54beb6d8467f', '34035aff-eb71-4bb5-a2bf-fe999a8f3280', '3a6591eb-ea58-4577-9c10-6d6411d36857'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:25 devstack sudo[104962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:48:25 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:25 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515" returned: 0 in 0.948s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:25 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2
Jul 06 15:48:25 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "cinder-d4dca53e-00de-4c9f-8fb6-df7c78b7c585-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-d4dca53e-00de-4c9f-8fb6-df7c78b7c585-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "cinder-quobyte-d4dca53e-00de-4c9f-8fb6-df7c78b7c585" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-quobyte-d4dca53e-00de-4c9f-8fb6-df7c78b7c585" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a8867d-c2d6-4322-b804-2a6fa0410a30]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:25 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc" returned: 0 in 0.775s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:25 devstack sudo[104968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585
Jul 06 15:48:25 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:25 devstack sudo[104970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.info
Jul 06 15:48:25 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:26 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.763s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:26 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:48:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Deleted volume successfully.
Jul 06 15:48:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e2d2468e-0ddd-4694-a440-4d4213d5dc70 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-160ddbaf-1de3-4c33-8427-73e951b95e0c-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:26 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2" returned: 0 in 0.872s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:26 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2
Jul 06 15:48:26 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:26 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585" returned: 0 in 0.814s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:26 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:26 devstack sudo[104982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585
Jul 06 15:48:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.info" returned: 0 in 0.705s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:26 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.info is being set with open permissions: ugo+rw
Jul 06 15:48:26 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:26 devstack sudo[104984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.info
Jul 06 15:48:26 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:27 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515.23ec7279-429d-4251-b03d-ac9864bf58f2" returned: 0 in 0.639s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-23ec7279-429d-4251-b03d-ac9864bf58f2" released by "_delete_snapshot" :: held 3.469s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-51cb3a65-6d9e-43ba-b842-d7448281e515" released by "delete_snapshot" :: held 3.496s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Created reservations ['8a82a4d3-dee7-4781-80dd-777e2b0dd6ce', '72d9d620-9d41-42f2-9da3-4f17843827c1', '29bd1fb5-29f9-4216-8c41-5883d9926471', 'e29daf44-243c-499a-a65e-c54a9870070b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Delete snapshot completed successfully.
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-f97d6feb-588a-4afc-ab57-1422ddb031a2 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-23ec7279-429d-4251-b03d-ac9864bf58f2-delete_snapshot" released by "delete_snapshot" :: held 3.649s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:27 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-d4dca53e-00de-4c9f-8fb6-df7c78b7c585" returned: 0 in 0.661s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-quobyte-d4dca53e-00de-4c9f-8fb6-df7c78b7c585" released by "delete_volume" :: held 1.525s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:27 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.info" returned: 0 in 0.669s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.864s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:27 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-62802510-022a-49b5-b8e2-44c5d49cd590 tempest-SnapshotDependencyTests-815217484 None] Create snapshot completed successfully
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Created reservations ['d93b6a62-c9cf-48c4-bd98-7314fafec0e3', '344a16ff-966a-43d1-9e1c-9ea15e057718', '286ce1d8-430c-45b8-819e-290867f02797', '77787000-6bd5-468b-8e87-c3b3b65b5251'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:27 devstack sudo[104989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:48:27 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-51cb3a65-6d9e-43ba-b842-d7448281e515-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-51cb3a65-6d9e-43ba-b842-d7448281e515-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-51cb3a65-6d9e-43ba-b842-d7448281e515" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-51cb3a65-6d9e-43ba-b842-d7448281e515" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:28 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74b0827-dfdc-4946-a12c-47715baeba63]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:28 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515
Jul 06 15:48:28 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:28 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.704s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:28 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:48:28 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Deleted volume successfully.
Jul 06 15:48:28 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-33d172cf-0ec5-4728-a923-0b5c5034feb4 tempest-CinderUnicodeTest-1058737351 None] Lock "cinder-d4dca53e-00de-4c9f-8fb6-df7c78b7c585-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:28 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515" returned: 0 in 0.842s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:28 devstack sudo[104998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515
Jul 06 15:48:28 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Flow 'volume_create_manager' (35cad300-1aa2-48e3-958e-e85bf68e21ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bfd57e-4dbf-4e1f-b422-0fdaaa4ab54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bfd57e-4dbf-4e1f-b422-0fdaaa4ab54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb77753c-7357-4621-895c-4721eb30ec19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceab94e278e54f519ccc5ef9ed7e77d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c568e662-f95f-4cf0-99d9-269f00f418cc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:29Z,use_quota=True,user_id='676d0f0f193f4a79b20af8578d3173f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faabb245-c0dd-4d1d-837f-af6f7601f154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faabb245-c0dd-4d1d-837f-af6f7601f154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d241784-eeee-4e69-b6a4-d24cdc7d6b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d241784-eeee-4e69-b6a4-d24cdc7d6b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb77753c-7357-4621-895c-4721eb30ec19', 'volume_name': 'volume-cb77753c-7357-4621-895c-4721eb30ec19', 'volume_size': 1, 'snapshot_id': 'c568e662-f95f-4cf0-99d9-269f00f418cc'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0b3366-afea-40d4-a564-8ec2f0b31502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0b3366-afea-40d4-a564-8ec2f0b31502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849a7730-f1cd-4446-b496-5e52df36b6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:29 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Volume cb77753c-7357-4621-895c-4721eb30ec19: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb77753c-7357-4621-895c-4721eb30ec19', 'volume_size': 1, 'snapshot_id': 'c568e662-f95f-4cf0-99d9-269f00f418cc'}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "cinder-quobyte-c568e662-f95f-4cf0-99d9-269f00f418cc-cb77753c-7357-4621-895c-4721eb30ec19" by "_create_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-c568e662-f95f-4cf0-99d9-269f00f418cc-cb77753c-7357-4621-895c-4721eb30ec19" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Creating volume cb77753c-7357-4621-895c-4721eb30ec19 from snapshot c568e662-f95f-4cf0-99d9-269f00f418cc {{(pid=86249) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "cinder-quobyte-cb77753c-7357-4621-895c-4721eb30ec19" by "_copy_volume_from_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-cb77753c-7357-4621-895c-4721eb30ec19" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] snapshot: c568e662-f95f-4cf0-99d9-269f00f418cc, volume: cb77753c-7357-4621-895c-4721eb30ec19,  {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=113,cinder:UPDATE=136,cinder:DELETE=12,cinder:INSERT=43 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b3296c-f9eb-42bc-89d8-5c1535b84604]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:29 devstack sudo[105000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc
Jul 06 15:48:29 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:29 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-51cb3a65-6d9e-43ba-b842-d7448281e515" returned: 0 in 0.728s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-51cb3a65-6d9e-43ba-b842-d7448281e515" released by "delete_volume" :: held 1.643s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Created reservations ['a6131b4c-5790-4393-8cf8-4766f0291d34', 'b66fd279-ed63-4387-921c-8d9146032eca', 'a9da233d-1743-4a6b-b6ca-849b7268b191', '6247fe3d-80d9-4f3f-bbab-26e8dffb128b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:29 devstack sudo[105003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:48:29 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:30 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc" returned: 0 in 0.881s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-743bc6a9-f0ff-4e94-890e-911d28019f7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Creating direct copy from snapshot {{(pid=86249) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fb0381-8fbc-4db1-b662-79fdc7861991]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:30 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c
Jul 06 15:48:30 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:30 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.767s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:48:30 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Deleted volume successfully.
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e377f48f-6e6e-4504-8d23-c3f65a756453 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-51cb3a65-6d9e-43ba-b842-d7448281e515-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=115,cinder:INSERT=37,cinder:UPDATE=140,cinder:DELETE=11 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (2157d570-8997-4c1c-a452-72a31446eb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8f7748-30a7-4695-be9d-092e7a7841c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8f7748-30a7-4695-be9d-092e7a7841c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668612402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2894a4b2-3b1c-4fa0-ba38-557a591adbc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:31Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af722b6-d35a-4422-ba45-c18ac704a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af722b6-d35a-4422-ba45-c18ac704a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254e6fc6-11fa-4b8a-9936-9402086401b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254e6fc6-11fa-4b8a-9936-9402086401b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2894a4b2-3b1c-4fa0-ba38-557a591adbc3', 'volume_name': 'volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc692f2-6761-4eea-abb2-37c9b2c6ad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc692f2-6761-4eea-abb2-37c9b2c6ad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b1e8e1-0573-4dc7-9107-959f0c71f6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:30 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Volume 2894a4b2-3b1c-4fa0-ba38-557a591adbc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3', 'volume_size': 1}
Jul 06 15:48:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:31 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c" returned: 0 in 0.894s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:31 devstack cinder-volume[86249]: DEBUG cinder.utils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Path /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19 not found in is_blk_device check {{(pid=86249) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 15:48:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:31 devstack sudo[105015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19
Jul 06 15:48:31 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:31 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1b6f011a-2c19-4d41-a99c-f1d941f18a4f tempest-ProjectAdminTests-51361242 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86249) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 06 15:48:36 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19" returned: 0 in 5.096s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:36 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f646e817-b730-4858-8f88-abb678d10a10]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:36 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c
Jul 06 15:48:36 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:37 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c" returned: 0 in 0.926s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG cinder.image.image_utils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Image conversion details: src /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19 {{(pid=86249) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 15:48:37 devstack cinder-volume[86249]: INFO cinder.image.image_utils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Converted 1024.00 MB image at 200.92 MB/s
Jul 06 15:48:37 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19 is being set with open permissions: ugo+rw
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:37 devstack sudo[105033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19
Jul 06 15:48:37 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:37 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19" returned: 0 in 0.652s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-cb77753c-7357-4621-895c-4721eb30ec19" released by "_copy_volume_from_snapshot" :: held 8.560s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-c568e662-f95f-4cf0-99d9-269f00f418cc-cb77753c-7357-4621-895c-4721eb30ec19" released by "_create_volume_from_snapshot" :: held 8.596s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.620s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.123s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668612402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2894a4b2-3b1c-4fa0-ba38-557a591adbc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:31Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Creating volume 2894a4b2-3b1c-4fa0-ba38-557a591adbc3 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:48:37 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:37 devstack sudo[105036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 1073741824
Jul 06 15:48:37 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849a7730-f1cd-4446-b496-5e52df36b6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb77753c-7357-4621-895c-4721eb30ec19', 'volume_size': 1, 'snapshot_id': 'c568e662-f95f-4cf0-99d9-269f00f418cc'}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f260422c-d2d3-4887-ad82-8f89c811c971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:38 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Volume volume-cb77753c-7357-4621-895c-4721eb30ec19 (cb77753c-7357-4621-895c-4721eb30ec19): created successfully
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f260422c-d2d3-4887-ad82-8f89c811c971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Flow 'volume_create_manager' (35cad300-1aa2-48e3-958e-e85bf68e21ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-36c56d1a-dddb-4c8b-b15e-acd1ab3dda68 tempest-SnapshotDependencyTests-815217484 None] Created volume successfully.
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Flow 'volume_create_manager' (04de470c-4bd7-472c-bd93-107fa3b90783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987fd2f2-77ff-40c9-918c-8061720f6255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987fd2f2-77ff-40c9-918c-8061720f6255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-33383415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208254b5-b47b-47bd-959a-a2839aac763e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeca66f5fcd42c8b5bc16c28199ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:38Z,use_quota=True,user_id='a2b1e79b26ca40689718c2774bd4bb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3894d7c-1224-4846-aaeb-bec789318be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3894d7c-1224-4846-aaeb-bec789318be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920bce85-113f-41c7-8254-29cb9d117fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920bce85-113f-41c7-8254-29cb9d117fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208254b5-b47b-47bd-959a-a2839aac763e', 'volume_name': 'volume-208254b5-b47b-47bd-959a-a2839aac763e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58dec8c-2986-43bc-9a4c-0936ab46ee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58dec8c-2986-43bc-9a4c-0936ab46ee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377926bc-6994-4c39-8825-19a7ecedb50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:38 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Volume 208254b5-b47b-47bd-959a-a2839aac763e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208254b5-b47b-47bd-959a-a2839aac763e', 'volume_size': 1}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:38 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 1073741824" returned: 0 in 0.831s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:38 devstack sudo[105042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3
Jul 06 15:48:38 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "cinder-c568e662-f95f-4cf0-99d9-269f00f418cc-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-c568e662-f95f-4cf0-99d9-269f00f418cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "cinder-quobyte-743bc6a9-f0ff-4e94-890e-911d28019f7c" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-743bc6a9-f0ff-4e94-890e-911d28019f7c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "cinder-quobyte-c568e662-f95f-4cf0-99d9-269f00f418cc" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-c568e662-f95f-4cf0-99d9-269f00f418cc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Deleting offline snapshot c568e662-f95f-4cf0-99d9-269f00f418cc of volume 743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] snapshot_file for this snap is: volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3d577c-02e7-48b4-b166-aaa0fd97a22f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:39 devstack sudo[105044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc
Jul 06 15:48:39 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:39 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" returned: 0 in 0.673s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.020s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-33383415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208254b5-b47b-47bd-959a-a2839aac763e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeca66f5fcd42c8b5bc16c28199ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:38Z,use_quota=True,user_id='a2b1e79b26ca40689718c2774bd4bb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Creating volume 208254b5-b47b-47bd-959a-a2839aac763e {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:48:39 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b1e8e1-0573-4dc7-9107-959f0c71f6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:39 devstack sudo[105047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e 1073741824
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f055d0cd-e638-41ec-b227-2f793389567d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:39 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:39 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Volume volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 (2894a4b2-3b1c-4fa0-ba38-557a591adbc3): created successfully
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f055d0cd-e638-41ec-b227-2f793389567d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (2157d570-8997-4c1c-a452-72a31446eb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:39 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a8cfdfce-deff-4c37-aa11-62fb74be669c tempest-ProjectMemberTests-1408538130 None] Created volume successfully.
Jul 06 15:48:39 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc" returned: 0 in 0.768s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-743bc6a9-f0ff-4e94-890e-911d28019f7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:48:40 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8ea4ac-3728-49df-ba64-d0a810ed0c05]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:40 devstack sudo[105052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c
Jul 06 15:48:40 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:40 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e 1073741824" returned: 0 in 0.815s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:40 devstack sudo[105058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e
Jul 06 15:48:40 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:40 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c" returned: 0 in 0.788s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:40 devstack sudo[105063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc
Jul 06 15:48:40 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:41 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e" returned: 0 in 0.767s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.408s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Creating offline snapshot ba69cc71-794b-4526-b2a4-06161e5b72be of volume 2894a4b2-3b1c-4fa0-ba38-557a591adbc3 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377926bc-6994-4c39-8825-19a7ecedb50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208254b5-b47b-47bd-959a-a2839aac763e', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18a8551-cb65-4aa5-8126-785f4849a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b4ee26-36a7-4f34-9e9b-ca659790f077]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:41 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Volume volume-208254b5-b47b-47bd-959a-a2839aac763e (208254b5-b47b-47bd-959a-a2839aac763e): created successfully
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18a8551-cb65-4aa5-8126-785f4849a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Flow 'volume_create_manager' (04de470c-4bd7-472c-bd93-107fa3b90783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:41 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1a9bd775-0935-48ac-9f7f-26a6450d2b75 tempest-ProjectReaderTests-2141113742 None] Created volume successfully.
Jul 06 15:48:41 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3
Jul 06 15:48:41 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:41 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc" returned: 0 in 0.768s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:41 devstack sudo[105071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc
Jul 06 15:48:41 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:42 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" returned: 0 in 0.885s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:42 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be 1G
Jul 06 15:48:42 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:42 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c.c568e662-f95f-4cf0-99d9-269f00f418cc" returned: 0 in 0.693s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-c568e662-f95f-4cf0-99d9-269f00f418cc" released by "_delete_snapshot" :: held 3.130s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-743bc6a9-f0ff-4e94-890e-911d28019f7c" released by "delete_snapshot" :: held 3.154s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:42 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Created reservations ['65cdaaf1-a8db-4a84-97ef-c56590d6a391', 'bf664b0a-4aad-43d0-b501-e172f20f7f2d', '3bc4f4e9-c77a-428c-a8c7-d4834fb7c796', 'a0481242-60dc-4eb9-aaf8-64c4c94408f4'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:42 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Delete snapshot completed successfully.
Jul 06 15:48:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-89c79573-25ca-4bc2-82b0-0af8f0f35a66 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-c568e662-f95f-4cf0-99d9-269f00f418cc-delete_snapshot" released by "delete_snapshot" :: held 3.295s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:42 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be 1G" returned: 0 in 0.818s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:42 devstack sudo[105082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be
Jul 06 15:48:42 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "cinder-743bc6a9-f0ff-4e94-890e-911d28019f7c-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-743bc6a9-f0ff-4e94-890e-911d28019f7c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "cinder-quobyte-743bc6a9-f0ff-4e94-890e-911d28019f7c" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-743bc6a9-f0ff-4e94-890e-911d28019f7c" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:43 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d06f0d-1a2c-40c2-88b8-509e6f12ce3d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:43 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be" returned: 0 in 0.716s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:43 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be is being set with open permissions: ugo+rw
Jul 06 15:48:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:43 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be
Jul 06 15:48:43 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:43 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c
Jul 06 15:48:43 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:44 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c" returned: 0 in 0.733s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:44 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c
Jul 06 15:48:44 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:44 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be" returned: 0 in 0.702s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:44 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.info
Jul 06 15:48:44 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:44 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-743bc6a9-f0ff-4e94-890e-911d28019f7c" returned: 0 in 0.672s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-743bc6a9-f0ff-4e94-890e-911d28019f7c" released by "delete_volume" :: held 1.469s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Created reservations ['eba73b0e-f1c3-424e-bb51-c67c5c0305ba', '96076c95-920c-4f97-9efb-a652ad2eac7d', 'ca17a0ef-1a12-4605-8654-97ff9f5341a8', 'f2952523-4690-446c-aa83-80e03b305f90'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:45 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.info" returned: 0 in 0.728s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:45 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.info is being set with open permissions: ugo+rw
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:45 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.info
Jul 06 15:48:45 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:45 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:48:45 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "cinder-cb77753c-7357-4621-895c-4721eb30ec19-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-cb77753c-7357-4621-895c-4721eb30ec19-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "cinder-quobyte-cb77753c-7357-4621-895c-4721eb30ec19" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-cb77753c-7357-4621-895c-4721eb30ec19" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d672b4fa-ab6d-4322-b54c-41679feb81db]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:45 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.info" returned: 0 in 0.777s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:45 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.733s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.128s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.767s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Creating offline snapshot 7f5253df-8d5a-483f-bdf2-75fd2f102621 of volume 208254b5-b47b-47bd-959a-a2839aac763e {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:48:45 devstack sudo[105107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19
Jul 06 15:48:45 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:45 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Deleted volume successfully.
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acb9b88-29c3-4edd-8b4e-0ae591e72137]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:45 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-41e94108-2491-4945-a613-77cf7d9c1f13 tempest-ProjectMemberTests-1408538130 None] Create snapshot completed successfully
Jul 06 15:48:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-1605a66b-3de7-42ed-a0c7-b48ee19eb434 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-743bc6a9-f0ff-4e94-890e-911d28019f7c-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:46 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e
Jul 06 15:48:46 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:46 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19" returned: 0 in 0.838s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:46 devstack sudo[105117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19
Jul 06 15:48:46 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:46 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e" returned: 0 in 0.762s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:46 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621 1G
Jul 06 15:48:46 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-ba69cc71-794b-4526-b2a4-06161e5b72be-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-ba69cc71-794b-4526-b2a4-06161e5b72be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-ba69cc71-794b-4526-b2a4-06161e5b72be" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-ba69cc71-794b-4526-b2a4-06161e5b72be" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Deleting offline snapshot ba69cc71-794b-4526-b2a4-06161e5b72be of volume 2894a4b2-3b1c-4fa0-ba38-557a591adbc3 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] snapshot_file for this snap is: volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d8cbbf-e5ae-416e-a24b-9e8c96d1afa2]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:47 devstack sudo[105121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be
Jul 06 15:48:47 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:47 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-cb77753c-7357-4621-895c-4721eb30ec19" returned: 0 in 0.743s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-quobyte-cb77753c-7357-4621-895c-4721eb30ec19" released by "delete_volume" :: held 1.631s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Created reservations ['5a9fda5c-e942-41e9-b810-06f0516397c4', '06139c93-0a99-496a-8e5d-a5b00623cd85', '9ef7ea93-fb1c-4cac-b3b5-434fc79971cc', '77542b03-b438-46f6-b9a8-1c032bfb5dee'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:47 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621 1G" returned: 0 in 0.860s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208254b5-b47b-47bd-959a-a2839aac763e -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:47 devstack sudo[105127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:48:47 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:47 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208254b5-b47b-47bd-959a-a2839aac763e -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621
Jul 06 15:48:47 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:48 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be" returned: 0 in 0.941s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec3e786-ff50-43a3-96a5-9c0f1d187387]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:48 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.708s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:48:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Deleted volume successfully.
Jul 06 15:48:48 devstack sudo[105136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3
Jul 06 15:48:48 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-8cff556b-778e-45dc-a481-c07da120a896 tempest-SnapshotDependencyTests-815217484 None] Lock "cinder-cb77753c-7357-4621-895c-4721eb30ec19-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:48 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208254b5-b47b-47bd-959a-a2839aac763e -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621" returned: 0 in 0.818s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:48 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621 is being set with open permissions: ugo+rw
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:48 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621
Jul 06 15:48:48 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:48 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" returned: 0 in 0.848s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:49 devstack sudo[105148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be
Jul 06 15:48:49 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:49 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621" returned: 0 in 0.708s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:49 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.info
Jul 06 15:48:49 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:49 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.info" returned: 0 in 0.724s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:49 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.info is being set with open permissions: ugo+rw
Jul 06 15:48:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:49 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.info
Jul 06 15:48:49 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:49 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be" returned: 0 in 0.956s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:49 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be
Jul 06 15:48:49 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:50 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.info" returned: 0 in 0.700s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.691s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:50 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-75a5ec5f-c9c6-4115-a9cf-55c4dd11afa8 tempest-ProjectReaderTests-2141113742 None] Create snapshot completed successfully
Jul 06 15:48:50 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3.ba69cc71-794b-4526-b2a4-06161e5b72be" returned: 0 in 0.824s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-ba69cc71-794b-4526-b2a4-06161e5b72be" released by "_delete_snapshot" :: held 3.707s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" released by "delete_snapshot" :: held 3.733s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:50 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Created reservations ['9be4dabc-8c8c-469d-9016-5332a8e2a12d', 'ec87e71a-5045-4c45-b215-48e196471b4b', '87dc4d4f-470a-483d-90bb-4e4979d32163', '484e01a8-a2f9-4cf7-89e3-e792549fd4b7'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:50 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Delete snapshot completed successfully.
Jul 06 15:48:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bbc690e-82ed-4da7-9f1a-1f7c5655873d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-ba69cc71-794b-4526-b2a4-06161e5b72be-delete_snapshot" released by "delete_snapshot" :: held 3.898s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-2894a4b2-3b1c-4fa0-ba38-557a591adbc3-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Lock "cinder-2894a4b2-3b1c-4fa0-ba38-557a591adbc3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-7f5253df-8d5a-483f-bdf2-75fd2f102621-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-7f5253df-8d5a-483f-bdf2-75fd2f102621-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-208254b5-b47b-47bd-959a-a2839aac763e" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-208254b5-b47b-47bd-959a-a2839aac763e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-7f5253df-8d5a-483f-bdf2-75fd2f102621" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-7f5253df-8d5a-483f-bdf2-75fd2f102621" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Deleting offline snapshot 7f5253df-8d5a-483f-bdf2-75fd2f102621 of volume 208254b5-b47b-47bd-959a-a2839aac763e {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] snapshot_file for this snap is: volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca47c82-ee2a-4e61-8f70-f47538e507b6]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f3afed-dcb7-4c12-b173-c8f6919d49b6]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:51 devstack sudo[105165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3
Jul 06 15:48:51 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:51 devstack sudo[105166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621
Jul 06 15:48:51 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:52 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" returned: 0 in 0.872s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:52 devstack sudo[105177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3
Jul 06 15:48:52 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:52 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621" returned: 0 in 0.927s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-208254b5-b47b-47bd-959a-a2839aac763e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:48:52 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a567235-0e5d-4b2c-85c5-6a939c201a93]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:52 devstack sudo[105179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e
Jul 06 15:48:52 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:53 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" returned: 0 in 0.762s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-2894a4b2-3b1c-4fa0-ba38-557a591adbc3" released by "delete_volume" :: held 1.720s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Created reservations ['9bd17fc1-99b5-44b2-8fca-30947c8c8532', 'b7ed13cc-87b2-4df0-8e49-ac8ae5a495bb', 'd0150a6b-6dce-494e-9d49-73de09c4d861', '5a7c4667-5944-4767-bb98-ae98c6f8c6ee'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:53 devstack sudo[105185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:48:53 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:53 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e" returned: 0 in 0.874s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:53 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621
Jul 06 15:48:53 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:54 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.885s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:48:54 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Deleted volume successfully.
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (b2573b76-5006-4ba6-bda5-024a45421fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e41229f-c294-4dea-9686-8a8161e420fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e41229f-c294-4dea-9686-8a8161e420fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058251069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b51af0-4e4d-4590-99d8-081242328ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:54Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa975e1-17d3-4a7a-8402-e6483a12bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa975e1-17d3-4a7a-8402-e6483a12bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353c9b9d-63dc-459f-8f1d-d3d5d003a270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353c9b9d-63dc-459f-8f1d-d3d5d003a270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b51af0-4e4d-4590-99d8-081242328ac4', 'volume_name': 'volume-05b51af0-4e4d-4590-99d8-081242328ac4', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:54 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f86e97-8c10-467b-8de7-c1b63bb9d13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f86e97-8c10-467b-8de7-c1b63bb9d13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8423ba86-6329-4909-87ae-a89ae730712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:54 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Volume 05b51af0-4e4d-4590-99d8-081242328ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b51af0-4e4d-4590-99d8-081242328ac4', 'volume_size': 1}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058251069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b51af0-4e4d-4590-99d8-081242328ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:54Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Creating volume 05b51af0-4e4d-4590-99d8-081242328ac4 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:48:54 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-cec21335-f78c-47c3-8580-83ea0136f97e tempest-ProjectMemberTests-1408538130 None] Lock "cinder-2894a4b2-3b1c-4fa0-ba38-557a591adbc3-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621" returned: 0 in 0.959s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:54 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4 1073741824
Jul 06 15:48:54 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:54 devstack sudo[105196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621
Jul 06 15:48:54 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:55 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e.7f5253df-8d5a-483f-bdf2-75fd2f102621" returned: 0 in 0.713s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-7f5253df-8d5a-483f-bdf2-75fd2f102621" released by "_delete_snapshot" :: held 3.607s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-208254b5-b47b-47bd-959a-a2839aac763e" released by "delete_snapshot" :: held 3.674s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Created reservations ['cd0c16d0-5464-443c-8feb-9d78bf9ef92a', 'c395f0a6-414a-4b49-be2b-4946bd34da26', '3695660b-d416-43dd-b409-c01e88669e69', 'db331763-ddb2-4a8b-8092-d80b0dbd4589'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Delete snapshot completed successfully.
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-5bece46d-326f-42b0-8a17-7cf7f12347d0 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-7f5253df-8d5a-483f-bdf2-75fd2f102621-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:55 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4 1073741824" returned: 0 in 0.941s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:55 devstack sudo[105204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4
Jul 06 15:48:55 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-208254b5-b47b-47bd-959a-a2839aac763e-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-208254b5-b47b-47bd-959a-a2839aac763e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-208254b5-b47b-47bd-959a-a2839aac763e" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-208254b5-b47b-47bd-959a-a2839aac763e" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f86b3d-bb6c-4537-8e0c-9266c9ea6344]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:55 devstack sudo[105206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e
Jul 06 15:48:55 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:56 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4" returned: 0 in 0.696s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8423ba86-6329-4909-87ae-a89ae730712d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b51af0-4e4d-4590-99d8-081242328ac4', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d973b937-2ff1-48cc-a496-5c6679bb0ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:56 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Volume volume-05b51af0-4e4d-4590-99d8-081242328ac4 (05b51af0-4e4d-4590-99d8-081242328ac4): created successfully
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d973b937-2ff1-48cc-a496-5c6679bb0ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (b2573b76-5006-4ba6-bda5-024a45421fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:56 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2c46c790-8547-4a9f-89f6-283ab2fdf60e tempest-ProjectMemberTests-1408538130 None] Created volume successfully.
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Creating offline snapshot 62737be2-849b-49e3-90ad-ad15f7792b46 of volume 05b51af0-4e4d-4590-99d8-081242328ac4 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d184228-f184-4409-8366-b9ac642f104b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:56 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e" returned: 0 in 0.860s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:56 devstack sudo[105214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4
Jul 06 15:48:56 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:56 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e
Jul 06 15:48:56 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:57 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4" returned: 0 in 0.812s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:57 devstack sudo[105222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46 1G
Jul 06 15:48:57 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:57 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-208254b5-b47b-47bd-959a-a2839aac763e" returned: 0 in 0.766s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-208254b5-b47b-47bd-959a-a2839aac763e" released by "delete_volume" :: held 1.690s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Created reservations ['1f9d384e-0d17-4c68-b80b-b4dac25ae5cc', '67963110-09a0-4e00-9325-9be088a6bcc6', 'a1436689-0e51-4f09-8759-9d014ca9cdd9', '324042cd-1df5-4d67-b8c5-81bf3deca929'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:48:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:57 devstack sudo[105224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:48:57 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:58 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46 1G" returned: 0 in 0.879s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b51af0-4e4d-4590-99d8-081242328ac4 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:58 devstack sudo[105230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b51af0-4e4d-4590-99d8-081242328ac4 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46
Jul 06 15:48:58 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:58 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.742s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:48:58 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Deleted volume successfully.
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7e879759-d4eb-4d82-a849-4434ac04fe29 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-208254b5-b47b-47bd-959a-a2839aac763e-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Flow 'volume_create_manager' (702016be-5279-4e95-b553-75c0587e1d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc8a3c1-3545-4b7d-8674-971cf336c4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc8a3c1-3545-4b7d-8674-971cf336c4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892730783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161c1ce2-8b4c-49d3-8d73-18654fac292f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeca66f5fcd42c8b5bc16c28199ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:58Z,use_quota=True,user_id='a2b1e79b26ca40689718c2774bd4bb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad53b70-7401-4c65-bf41-a165294789fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad53b70-7401-4c65-bf41-a165294789fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d2f0d4-abf5-48fa-ac77-c1157e79a78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d2f0d4-abf5-48fa-ac77-c1157e79a78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161c1ce2-8b4c-49d3-8d73-18654fac292f', 'volume_name': 'volume-161c1ce2-8b4c-49d3-8d73-18654fac292f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a131518-5b13-4fa5-be7c-3a36891e74b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a131518-5b13-4fa5-be7c-3a36891e74b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83437b55-c7aa-441a-93e1-e85bdb0257aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:48:58 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Volume 161c1ce2-8b4c-49d3-8d73-18654fac292f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161c1ce2-8b4c-49d3-8d73-18654fac292f', 'volume_size': 1}
Jul 06 15:48:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:48:59 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b51af0-4e4d-4590-99d8-081242328ac4 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46" returned: 0 in 0.776s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:59 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46 is being set with open permissions: ugo+rw
Jul 06 15:48:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:59 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46
Jul 06 15:48:59 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:48:59 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Jul 06 15:48:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46" returned: 0 in 0.629s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:48:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:48:59 devstack sudo[105239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.info
Jul 06 15:48:59 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:00 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.info" returned: 0 in 0.627s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:00 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.info is being set with open permissions: ugo+rw
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:00 devstack sudo[105242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.info
Jul 06 15:49:00 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:00 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.info" returned: 0 in 0.609s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.409s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892730783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161c1ce2-8b4c-49d3-8d73-18654fac292f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeca66f5fcd42c8b5bc16c28199ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:58Z,use_quota=True,user_id='a2b1e79b26ca40689718c2774bd4bb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Creating volume 161c1ce2-8b4c-49d3-8d73-18654fac292f {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:49:00 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:49:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:00 devstack sudo[105246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f 1073741824
Jul 06 15:49:00 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:00 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6604b6d7-8935-42e4-835d-ab422d38035b tempest-ProjectMemberTests-1408538130 None] Create snapshot completed successfully
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-62737be2-849b-49e3-90ad-ad15f7792b46-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-62737be2-849b-49e3-90ad-ad15f7792b46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:01 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-05b51af0-4e4d-4590-99d8-081242328ac4" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f 1073741824" returned: 0 in 0.908s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-05b51af0-4e4d-4590-99d8-081242328ac4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-62737be2-849b-49e3-90ad-ad15f7792b46" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-62737be2-849b-49e3-90ad-ad15f7792b46" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Deleting offline snapshot 62737be2-849b-49e3-90ad-ad15f7792b46 of volume 05b51af0-4e4d-4590-99d8-081242328ac4 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] snapshot_file for this snap is: volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[feefcf87-2afe-4f0b-b9f3-09031ecb7d7f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:01 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f
Jul 06 15:49:01 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:02 devstack sudo[105251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46
Jul 06 15:49:02 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:02 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f" returned: 0 in 0.707s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83437b55-c7aa-441a-93e1-e85bdb0257aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161c1ce2-8b4c-49d3-8d73-18654fac292f', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9029169-252f-451d-b143-45e0bf6822df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:02 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Volume volume-161c1ce2-8b4c-49d3-8d73-18654fac292f (161c1ce2-8b4c-49d3-8d73-18654fac292f): created successfully
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9029169-252f-451d-b143-45e0bf6822df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Flow 'volume_create_manager' (702016be-5279-4e95-b553-75c0587e1d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:02 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:02 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3bafb19a-42ca-4575-8ae7-278fb1ee8b66 tempest-ProjectReaderTests-2141113742 None] Created volume successfully.
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46" returned: 0 in 0.790s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b51af0-4e4d-4590-99d8-081242328ac4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0522d8a0-3084-4cb3-bbfe-1193b13e94d5]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:02 devstack sudo[105259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4
Jul 06 15:49:02 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:03 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4" returned: 0 in 0.720s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:03 devstack sudo[105264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46
Jul 06 15:49:03 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:03 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:03 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Creating offline snapshot df063637-94f4-400e-a907-db464b2aa099 of volume 161c1ce2-8b4c-49d3-8d73-18654fac292f {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:49:04 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41cace8-8b38-4e41-900d-153cb2994ef7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:04 devstack sudo[105266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f
Jul 06 15:49:04 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:04 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46" returned: 0 in 0.766s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:04 devstack sudo[105271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46
Jul 06 15:49:04 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:04 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f" returned: 0 in 0.763s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:04 devstack sudo[105277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099 1G
Jul 06 15:49:04 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:04 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4.62737be2-849b-49e3-90ad-ad15f7792b46" returned: 0 in 0.640s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-62737be2-849b-49e3-90ad-ad15f7792b46" released by "_delete_snapshot" :: held 3.021s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-05b51af0-4e4d-4590-99d8-081242328ac4" released by "delete_snapshot" :: held 3.044s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:04 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Created reservations ['0225f617-722f-46d6-a2a1-afec0a293b1c', 'd61545b0-086a-4c55-92b1-f0cc71df89df', 'f911b928-0cc8-44f7-ae1d-7d23d5ca12ee', '06f0c295-b48f-49a2-843d-9a9378de7fa0'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:05 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Delete snapshot completed successfully.
Jul 06 15:49:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ce5470e0-ebf6-4387-823a-668ad243f609 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-62737be2-849b-49e3-90ad-ad15f7792b46-delete_snapshot" released by "delete_snapshot" :: held 3.196s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:05 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099 1G" returned: 0 in 0.791s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-161c1ce2-8b4c-49d3-8d73-18654fac292f -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:05 devstack sudo[105282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-161c1ce2-8b4c-49d3-8d73-18654fac292f -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099
Jul 06 15:49:05 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-05b51af0-4e4d-4590-99d8-081242328ac4-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-05b51af0-4e4d-4590-99d8-081242328ac4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-05b51af0-4e4d-4590-99d8-081242328ac4" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-05b51af0-4e4d-4590-99d8-081242328ac4" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4efcd93-66e3-49d3-8f01-57a4a379beaf]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:06 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-161c1ce2-8b4c-49d3-8d73-18654fac292f -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099" returned: 0 in 0.708s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:06 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099 is being set with open permissions: ugo+rw
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:06 devstack sudo[105288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099
Jul 06 15:49:06 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:06 devstack sudo[105287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4
Jul 06 15:49:06 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:06 devstack sudo[105291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:49:06 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:06 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099" returned: 0 in 0.624s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:06 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.info
Jul 06 15:49:06 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:06 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4" returned: 0 in 0.780s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:07 devstack sudo[105299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4
Jul 06 15:49:07 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:07 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.678s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:49:07 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.info" returned: 0 in 0.697s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:07 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.info is being set with open permissions: ugo+rw
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:07 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-05b51af0-4e4d-4590-99d8-081242328ac4" returned: 0 in 0.650s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:07 devstack sudo[105305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.info
Jul 06 15:49:07 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-05b51af0-4e4d-4590-99d8-081242328ac4" released by "delete_volume" :: held 1.493s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Created reservations ['d7c5ca1c-1e6e-462f-92dd-57aebb5fd852', '99c1b481-7e4b-4420-a7ae-3ec06193bb72', '5cc9d50c-aa91-4584-8ef0-d6e61bbf1f2e', 'a7bfa8e0-db09-41bb-86c1-d4d8cf21ba7e'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:07 devstack sudo[105307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:49:07 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:08 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.info" returned: 0 in 0.645s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.309s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:08 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-10d547a7-6911-4ef8-9e62-c768489a9048 tempest-ProjectReaderTests-2141113742 None] Create snapshot completed successfully
Jul 06 15:49:08 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.634s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:49:08 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Deleted volume successfully.
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a7a8ed49-eef5-4638-824c-3b8fb527cf15 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-05b51af0-4e4d-4590-99d8-081242328ac4-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (d633eee9-f9e0-40dc-ac52-44a05aab0ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed54c0dc-52bc-4c8b-a415-584c1106d0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed54c0dc-52bc-4c8b-a415-584c1106d0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447739297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40cde6b9-6369-4151-ab57-867de0f409c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:09Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67354d9f-4113-42b0-a8b4-55e2393f2555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67354d9f-4113-42b0-a8b4-55e2393f2555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd2e2a6-6b1a-4516-83ee-1e9350de541f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd2e2a6-6b1a-4516-83ee-1e9350de541f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40cde6b9-6369-4151-ab57-867de0f409c9', 'volume_name': 'volume-40cde6b9-6369-4151-ab57-867de0f409c9', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cb73b4-5109-46e4-99cd-fb435fec0a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cb73b4-5109-46e4-99cd-fb435fec0a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f824c6ec-df9a-42f6-881b-a43ba2d8d5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:08 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Volume 40cde6b9-6369-4151-ab57-867de0f409c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40cde6b9-6369-4151-ab57-867de0f409c9', 'volume_size': 1}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447739297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40cde6b9-6369-4151-ab57-867de0f409c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:09Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Creating volume 40cde6b9-6369-4151-ab57-867de0f409c9 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:49:08 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:49:08 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:08 devstack sudo[105311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9 1073741824
Jul 06 15:49:08 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-df063637-94f4-400e-a907-db464b2aa099-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Lock "cinder-df063637-94f4-400e-a907-db464b2aa099-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-161c1ce2-8b4c-49d3-8d73-18654fac292f" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-161c1ce2-8b4c-49d3-8d73-18654fac292f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-df063637-94f4-400e-a907-db464b2aa099" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-df063637-94f4-400e-a907-db464b2aa099" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Deleting offline snapshot df063637-94f4-400e-a907-db464b2aa099 of volume 161c1ce2-8b4c-49d3-8d73-18654fac292f {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] snapshot_file for this snap is: volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bb14d0-cb91-4f7e-ac73-d3e962042499]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:09 devstack sudo[105313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099
Jul 06 15:49:09 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:09 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9 1073741824" returned: 0 in 0.795s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:09 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:09 devstack sudo[105320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9
Jul 06 15:49:09 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:10 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099" returned: 0 in 0.777s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-161c1ce2-8b4c-49d3-8d73-18654fac292f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8b744c-e489-4f68-a7c2-6ac41585b508]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:10 devstack sudo[105325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f
Jul 06 15:49:10 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:10 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9" returned: 0 in 0.667s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f824c6ec-df9a-42f6-881b-a43ba2d8d5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40cde6b9-6369-4151-ab57-867de0f409c9', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76db71aa-7f37-48fe-b24b-0d50901493e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:10 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Volume volume-40cde6b9-6369-4151-ab57-867de0f409c9 (40cde6b9-6369-4151-ab57-867de0f409c9): created successfully
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76db71aa-7f37-48fe-b24b-0d50901493e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (d633eee9-f9e0-40dc-ac52-44a05aab0ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:10 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-5393f0f1-745d-4803-a8ce-698082d6024e tempest-ProjectMemberTests-1408538130 None] Created volume successfully.
Jul 06 15:49:10 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f" returned: 0 in 0.796s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:10 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:10 devstack sudo[105332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099
Jul 06 15:49:10 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:11 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Creating offline snapshot 22302eb9-5f86-4ba7-a795-7e2494894717 of volume 40cde6b9-6369-4151-ab57-867de0f409c9 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:49:11 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5735f7-6e13-4962-b589-b4e13fc76a8b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:11 devstack sudo[105334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9
Jul 06 15:49:11 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:11 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099" returned: 0 in 0.745s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:11 devstack sudo[105339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099
Jul 06 15:49:11 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:11 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9" returned: 0 in 0.774s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:11 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:11 devstack sudo[105344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717 1G
Jul 06 15:49:11 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:12 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f.df063637-94f4-400e-a907-db464b2aa099" returned: 0 in 0.733s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-df063637-94f4-400e-a907-db464b2aa099" released by "_delete_snapshot" :: held 3.144s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-161c1ce2-8b4c-49d3-8d73-18654fac292f" released by "delete_snapshot" :: held 3.165s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:12 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Created reservations ['389f8589-c414-4db6-b355-6c0855ee005f', '176ff80c-cf73-4a21-af97-ac9840bce1e9', '0b6a7129-0c70-4854-ba5d-42ee04d5c8b5', '93d4209b-402a-44e6-870a-24e24f8d0ba4'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:12 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Delete snapshot completed successfully.
Jul 06 15:49:12 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c33055d8-68bc-482f-9406-5455e1013d3b tempest-ProjectReaderTests-2141113742 None] Lock "cinder-df063637-94f4-400e-a907-db464b2aa099-delete_snapshot" released by "delete_snapshot" :: held 3.315s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:12 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717 1G" returned: 0 in 0.797s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:12 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40cde6b9-6369-4151-ab57-867de0f409c9 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:12 devstack sudo[105351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40cde6b9-6369-4151-ab57-867de0f409c9 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717
Jul 06 15:49:12 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:13 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40cde6b9-6369-4151-ab57-867de0f409c9 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717" returned: 0 in 0.724s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:13 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717 is being set with open permissions: ugo+rw
Jul 06 15:49:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:13 devstack sudo[105356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717
Jul 06 15:49:13 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-161c1ce2-8b4c-49d3-8d73-18654fac292f-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Lock "cinder-161c1ce2-8b4c-49d3-8d73-18654fac292f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-161c1ce2-8b4c-49d3-8d73-18654fac292f" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:13 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-161c1ce2-8b4c-49d3-8d73-18654fac292f" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:13 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4704a7c8-7b66-4e3b-826c-17a56c0ce35a]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:13 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:13 devstack sudo[105358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f
Jul 06 15:49:13 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:14 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717" returned: 0 in 0.728s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:14 devstack sudo[105361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.info
Jul 06 15:49:14 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:14 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f" returned: 0 in 0.810s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:14 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f
Jul 06 15:49:14 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:14 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.info" returned: 0 in 0.672s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:14 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.info is being set with open permissions: ugo+rw
Jul 06 15:49:14 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:14 devstack sudo[105369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.info
Jul 06 15:49:14 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:15 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-161c1ce2-8b4c-49d3-8d73-18654fac292f" returned: 0 in 0.675s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-161c1ce2-8b4c-49d3-8d73-18654fac292f" released by "delete_volume" :: held 1.548s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Created reservations ['4f9ecd03-6860-46ab-9ebd-a19297c6e713', '49fdf8ee-f65a-419a-81f5-62ba6765bb30', '12ebae39-417c-4183-91a2-12bd93129aab', '022c4e4b-84af-4aec-b9d2-541d6669bdc2'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:15 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:49:15 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:15 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.info" returned: 0 in 0.747s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.531s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-43a498d8-2fc2-48e0-822e-dacbd62943cc tempest-ProjectMemberTests-1408538130 None] Create snapshot completed successfully
Jul 06 15:49:15 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.695s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:49:15 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Deleted volume successfully.
Jul 06 15:49:15 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-0b9b73de-5be9-41de-b902-7596968a6c9c tempest-ProjectReaderTests-2141113742 None] Lock "cinder-161c1ce2-8b4c-49d3-8d73-18654fac292f-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Flow 'volume_create_manager' (ed1117d1-6954-4c4a-967c-7dc4e7b8132a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b71d3b4-c677-467d-95a4-287ca366a3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b71d3b4-c677-467d-95a4-287ca366a3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910808405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df837065-2a24-45c0-8a79-e569d484e8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeca66f5fcd42c8b5bc16c28199ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:16Z,use_quota=True,user_id='a2b1e79b26ca40689718c2774bd4bb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e69e8bd-022f-4070-a25b-491eef8ef502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e69e8bd-022f-4070-a25b-491eef8ef502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27c7d59-9d61-46ed-8c98-c17792b030c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27c7d59-9d61-46ed-8c98-c17792b030c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df837065-2a24-45c0-8a79-e569d484e8d2', 'volume_name': 'volume-df837065-2a24-45c0-8a79-e569d484e8d2', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd96048-3fc1-40bb-bfdb-210c5edfccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd96048-3fc1-40bb-bfdb-210c5edfccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cbbeac-a0c0-40be-b2c0-26777757ec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:16 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Volume df837065-2a24-45c0-8a79-e569d484e8d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df837065-2a24-45c0-8a79-e569d484e8d2', 'volume_size': 1}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910808405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df837065-2a24-45c0-8a79-e569d484e8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeca66f5fcd42c8b5bc16c28199ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:16Z,use_quota=True,user_id='a2b1e79b26ca40689718c2774bd4bb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Creating volume df837065-2a24-45c0-8a79-e569d484e8d2 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:49:16 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-22302eb9-5f86-4ba7-a795-7e2494894717-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:16 devstack sudo[105376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2 1073741824
Jul 06 15:49:16 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Lock "cinder-22302eb9-5f86-4ba7-a795-7e2494894717-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-40cde6b9-6369-4151-ab57-867de0f409c9" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-40cde6b9-6369-4151-ab57-867de0f409c9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-22302eb9-5f86-4ba7-a795-7e2494894717" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-22302eb9-5f86-4ba7-a795-7e2494894717" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Deleting offline snapshot 22302eb9-5f86-4ba7-a795-7e2494894717 of volume 40cde6b9-6369-4151-ab57-867de0f409c9 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] snapshot_file for this snap is: volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b6e46a-6cef-469b-b8e2-819270bcafbd]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:16 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:16 devstack sudo[105378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717
Jul 06 15:49:16 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:17 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2 1073741824" returned: 0 in 0.935s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:17 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717" returned: 0 in 0.859s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:17 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40cde6b9-6369-4151-ab57-867de0f409c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:49:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:17 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7729dab-bf0c-411c-bd38-278c6d49587b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:17 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:17 devstack sudo[105423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2
Jul 06 15:49:17 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:17 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9
Jul 06 15:49:17 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:18 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2" returned: 0 in 0.733s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cbbeac-a0c0-40be-b2c0-26777757ec9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df837065-2a24-45c0-8a79-e569d484e8d2', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee73ad0-d352-476d-836e-b6b703d8ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:18 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Volume volume-df837065-2a24-45c0-8a79-e569d484e8d2 (df837065-2a24-45c0-8a79-e569d484e8d2): created successfully
Jul 06 15:49:18 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee73ad0-d352-476d-836e-b6b703d8ce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Flow 'volume_create_manager' (ed1117d1-6954-4c4a-967c-7dc4e7b8132a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9" returned: 0 in 0.780s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:18 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-8bd86e84-b4a4-4587-a65e-50f1af83d83c tempest-ProjectReaderTests-2141113742 None] Created volume successfully.
Jul 06 15:49:18 devstack sudo[105431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717
Jul 06 15:49:18 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Creating offline snapshot 91696ac7-b672-4238-90d3-0c72f384ede2 of volume df837065-2a24-45c0-8a79-e569d484e8d2 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[058ce7fa-1c76-4191-91d7-9f53a7dcbeff]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:18 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2
Jul 06 15:49:18 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:18 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717" returned: 0 in 0.786s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:18 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:18 devstack sudo[105438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717
Jul 06 15:49:18 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:19 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2" returned: 0 in 0.782s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:19 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2 1G
Jul 06 15:49:19 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:19 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:19 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9.22302eb9-5f86-4ba7-a795-7e2494894717" returned: 0 in 0.667s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-22302eb9-5f86-4ba7-a795-7e2494894717" released by "_delete_snapshot" :: held 3.196s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-40cde6b9-6369-4151-ab57-867de0f409c9" released by "delete_snapshot" :: held 3.224s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:19 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Created reservations ['bb61cc65-96d1-4144-bc57-0a89c56e6ade', '9701f679-2ca3-442a-90e9-6930d80dac09', 'de711d2d-786c-4079-8be5-74e06dfafd25', '7864f1b3-1898-4c7b-93e7-96d39f7afa58'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:19 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Delete snapshot completed successfully.
Jul 06 15:49:19 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ed94f8c7-f982-4665-8fce-ba56c884bb0f tempest-ProjectMemberTests-1408538130 None] Lock "cinder-22302eb9-5f86-4ba7-a795-7e2494894717-delete_snapshot" released by "delete_snapshot" :: held 3.369s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:20 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2 1G" returned: 0 in 0.775s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df837065-2a24-45c0-8a79-e569d484e8d2 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:20 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df837065-2a24-45c0-8a79-e569d484e8d2 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2
Jul 06 15:49:20 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-40cde6b9-6369-4151-ab57-867de0f409c9-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-40cde6b9-6369-4151-ab57-867de0f409c9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-40cde6b9-6369-4151-ab57-867de0f409c9" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:20 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-40cde6b9-6369-4151-ab57-867de0f409c9" acquired by "delete_volume" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:20 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b39259-971b-46ec-8294-129327baa365]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:20 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df837065-2a24-45c0-8a79-e569d484e8d2 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2" returned: 0 in 0.694s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:20 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2 is being set with open permissions: ugo+rw
Jul 06 15:49:20 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:20 devstack sudo[105455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9
Jul 06 15:49:20 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2
Jul 06 15:49:20 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:20 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:21 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9" returned: 0 in 0.746s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:21 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2" returned: 0 in 0.665s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:21 devstack sudo[105464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9
Jul 06 15:49:21 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:21 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:21 devstack sudo[105466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.info
Jul 06 15:49:21 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:22 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-40cde6b9-6369-4151-ab57-867de0f409c9" returned: 0 in 0.656s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-40cde6b9-6369-4151-ab57-867de0f409c9" released by "delete_volume" :: held 1.462s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:22 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.info" returned: 0 in 0.669s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:22 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.info is being set with open permissions: ugo+rw
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:22 devstack sudo[105470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.info
Jul 06 15:49:22 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Created reservations ['b49c497f-e3af-446a-8dda-bc1ac6ac7fa3', 'dafbeec3-2c8b-44e8-8a7b-2ea78d16db6b', '05e32776-ce37-4a97-a286-7fbd04da5efa', '8b5f9c37-9bed-4459-b59a-7be6cc3a19e9'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:22 devstack sudo[105472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:49:22 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:22 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.info" returned: 0 in 0.665s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.344s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-85dd8b28-7eee-45d2-b401-049eee1a7d8b tempest-ProjectReaderTests-2141113742 None] Create snapshot completed successfully
Jul 06 15:49:22 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.668s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:49:22 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Deleted volume successfully.
Jul 06 15:49:22 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-d7a0dc79-32aa-4fe9-b8ca-c49470f73498 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-40cde6b9-6369-4151-ab57-867de0f409c9-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (81c41d8a-f21d-478e-bb34-e32b38279b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fb23c7-1068-47e8-89f8-4740d5edf02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fb23c7-1068-47e8-89f8-4740d5edf02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1573915284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea044a7f-392f-497f-9271-0df4455f2aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:23Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39600a13-2f3d-467f-8f90-becf8316448f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39600a13-2f3d-467f-8f90-becf8316448f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1088832a-cbc3-4072-a19b-15d88cdc8c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1088832a-cbc3-4072-a19b-15d88cdc8c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea044a7f-392f-497f-9271-0df4455f2aab', 'volume_name': 'volume-ea044a7f-392f-497f-9271-0df4455f2aab', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d42416-3148-4d3c-b148-2ec19e61c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d42416-3148-4d3c-b148-2ec19e61c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a14f2d-58f3-408a-b94b-4a418f301157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:23 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Volume ea044a7f-392f-497f-9271-0df4455f2aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea044a7f-392f-497f-9271-0df4455f2aab', 'volume_size': 1}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1573915284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea044a7f-392f-497f-9271-0df4455f2aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:23Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Creating volume ea044a7f-392f-497f-9271-0df4455f2aab {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:49:23 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:23 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab 1073741824
Jul 06 15:49:23 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-91696ac7-b672-4238-90d3-0c72f384ede2-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-91696ac7-b672-4238-90d3-0c72f384ede2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-df837065-2a24-45c0-8a79-e569d484e8d2" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-df837065-2a24-45c0-8a79-e569d484e8d2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-91696ac7-b672-4238-90d3-0c72f384ede2" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-91696ac7-b672-4238-90d3-0c72f384ede2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Deleting offline snapshot 91696ac7-b672-4238-90d3-0c72f384ede2 of volume df837065-2a24-45c0-8a79-e569d484e8d2 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] snapshot_file for this snap is: volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8520bdf-7690-4807-bb8d-3cf32b872597]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:23 devstack sudo[105478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2
Jul 06 15:49:23 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:24 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab 1073741824" returned: 0 in 0.800s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:24 devstack sudo[105484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab
Jul 06 15:49:24 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:24 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2" returned: 0 in 0.759s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df837065-2a24-45c0-8a79-e569d484e8d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[69757487-fa10-4204-b77d-74862b26b753]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:24 devstack sudo[105495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2
Jul 06 15:49:24 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:24 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab" returned: 0 in 0.717s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a14f2d-58f3-408a-b94b-4a418f301157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea044a7f-392f-497f-9271-0df4455f2aab', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9a857d-a8d9-4d4e-9037-4803dd75f98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:24 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Volume volume-ea044a7f-392f-497f-9271-0df4455f2aab (ea044a7f-392f-497f-9271-0df4455f2aab): created successfully
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9a857d-a8d9-4d4e-9037-4803dd75f98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (81c41d8a-f21d-478e-bb34-e32b38279b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:24 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c79720c3-0876-43f8-834a-9e01932f177f tempest-ProjectMemberTests-1408538130 None] Created volume successfully.
Jul 06 15:49:25 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2" returned: 0 in 0.736s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:25 devstack sudo[105501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2
Jul 06 15:49:25 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:25 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Creating offline snapshot 53627bd7-5e87-4c7b-a992-e3bb6341a2b0 of volume ea044a7f-392f-497f-9271-0df4455f2aab {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:49:25 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2e55b1-6489-4889-9139-a95487980306]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:25 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab
Jul 06 15:49:25 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:25 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2" returned: 0 in 0.747s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:26 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2
Jul 06 15:49:26 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:26 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab" returned: 0 in 0.745s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:26 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0 1G
Jul 06 15:49:26 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:26 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2.91696ac7-b672-4238-90d3-0c72f384ede2" returned: 0 in 0.669s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-91696ac7-b672-4238-90d3-0c72f384ede2" released by "_delete_snapshot" :: held 3.004s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-df837065-2a24-45c0-8a79-e569d484e8d2" released by "delete_snapshot" :: held 3.026s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Created reservations ['00cf8e78-e1f4-4566-87ee-9fa597b21dc1', '28995594-12e7-497f-90ed-26501b6489dd', 'e07c3914-ced4-43db-9409-e35d4c133f27', 'a86fa9d1-3dbd-4b74-8eec-f6edd59f781b'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Delete snapshot completed successfully.
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-38ff0d17-d785-4713-a3ad-d03caab56163 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-91696ac7-b672-4238-90d3-0c72f384ede2-delete_snapshot" released by "delete_snapshot" :: held 3.173s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:26 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0 1G" returned: 0 in 0.800s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea044a7f-392f-497f-9271-0df4455f2aab -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:27 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea044a7f-392f-497f-9271-0df4455f2aab -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0
Jul 06 15:49:27 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:27 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea044a7f-392f-497f-9271-0df4455f2aab -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0" returned: 0 in 0.674s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:27 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0 is being set with open permissions: ugo+rw
Jul 06 15:49:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:27 devstack sudo[105524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0
Jul 06 15:49:27 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-df837065-2a24-45c0-8a79-e569d484e8d2-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-df837065-2a24-45c0-8a79-e569d484e8d2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-df837065-2a24-45c0-8a79-e569d484e8d2" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:27 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-df837065-2a24-45c0-8a79-e569d484e8d2" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:27 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b326aed-f173-4b0e-b97c-95bbfbee2904]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:28 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2
Jul 06 15:49:28 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:28 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0" returned: 0 in 0.635s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:28 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.info
Jul 06 15:49:28 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:28 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2" returned: 0 in 0.768s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:28 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2
Jul 06 15:49:28 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:28 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.info" returned: 0 in 0.642s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:28 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.info is being set with open permissions: ugo+rw
Jul 06 15:49:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:28 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.info
Jul 06 15:49:28 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:29 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-df837065-2a24-45c0-8a79-e569d484e8d2" returned: 0 in 0.612s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-df837065-2a24-45c0-8a79-e569d484e8d2" released by "delete_volume" :: held 1.438s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Created reservations ['bd1bcf86-f7f1-4382-8c0b-89e014ad11ab', '37a94c46-f57b-4d9c-94a2-0e8a8991ef70', '2a06e3b1-4fae-47c2-af6b-19d611021243', 'ac663db3-9e60-4e10-b840-faae0f0e1c89'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=109,cinder:INSERT=33,cinder:UPDATE=138,cinder:DELETE=13 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:29 devstack sudo[105540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:49:29 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:29 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.info" returned: 0 in 0.665s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.240s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:29 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ddc248e6-c789-4f6c-ad1a-d6a143c41d31 tempest-ProjectMemberTests-1408538130 None] Create snapshot completed successfully
Jul 06 15:49:30 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.656s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:49:30 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Deleted volume successfully.
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-c507b884-6375-4ba7-8594-bf6fad918ed0 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-df837065-2a24-45c0-8a79-e569d484e8d2-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Flow 'volume_create_manager' (69a12f18-36c1-4897-bd7f-5e81833c428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8faadfb8-8d03-4c5f-89fd-64f98d6846df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8faadfb8-8d03-4c5f-89fd-64f98d6846df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1658159596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bd5b12-df6a-4a3c-971f-bfac8f2913a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeca66f5fcd42c8b5bc16c28199ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:30Z,use_quota=True,user_id='a2b1e79b26ca40689718c2774bd4bb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0c69e9-d2dc-4df5-8b48-3472ff34151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0c69e9-d2dc-4df5-8b48-3472ff34151b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b272fff3-e480-44dc-949c-78024aed3188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b272fff3-e480-44dc-949c-78024aed3188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1bd5b12-df6a-4a3c-971f-bfac8f2913a5', 'volume_name': 'volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0c1ffe-77d5-4edf-bc4c-1d456fcb4d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0c1ffe-77d5-4edf-bc4c-1d456fcb4d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f556b844-0733-4253-a80c-348ddd571beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:30 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Volume c1bd5b12-df6a-4a3c-971f-bfac8f2913a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5', 'volume_size': 1}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1658159596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bd5b12-df6a-4a3c-971f-bfac8f2913a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeca66f5fcd42c8b5bc16c28199ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:30Z,use_quota=True,user_id='a2b1e79b26ca40689718c2774bd4bb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Creating volume c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:49:30 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:30 devstack sudo[105545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 1073741824
Jul 06 15:49:30 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-53627bd7-5e87-4c7b-a992-e3bb6341a2b0-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-53627bd7-5e87-4c7b-a992-e3bb6341a2b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-ea044a7f-392f-497f-9271-0df4455f2aab" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-ea044a7f-392f-497f-9271-0df4455f2aab" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-53627bd7-5e87-4c7b-a992-e3bb6341a2b0" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-53627bd7-5e87-4c7b-a992-e3bb6341a2b0" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Deleting offline snapshot 53627bd7-5e87-4c7b-a992-e3bb6341a2b0 of volume ea044a7f-392f-497f-9271-0df4455f2aab {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] snapshot_file for this snap is: volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ee7b0c-6890-443e-98e6-567136dbda42]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:30 devstack sudo[105547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0
Jul 06 15:49:30 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:31 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 1073741824" returned: 0 in 0.810s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:31 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=139,cinder:DELETE=10,cinder:SELECT=103,cinder:INSERT=44 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:49:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:31 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5
Jul 06 15:49:31 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:31 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0" returned: 0 in 0.835s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:31 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea044a7f-392f-497f-9271-0df4455f2aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:49:31 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd3fa37-f42c-47e6-8960-82962304ab59]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:31 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab
Jul 06 15:49:31 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:32 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" returned: 0 in 0.686s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f556b844-0733-4253-a80c-348ddd571beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8285ef-4733-40ef-90aa-16e1da13cb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:32 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Volume volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 (c1bd5b12-df6a-4a3c-971f-bfac8f2913a5): created successfully
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8285ef-4733-40ef-90aa-16e1da13cb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Flow 'volume_create_manager' (69a12f18-36c1-4897-bd7f-5e81833c428a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:32 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9c09a48c-b30f-4817-833e-868ec993fdad tempest-ProjectReaderTests-2141113742 None] Created volume successfully.
Jul 06 15:49:32 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab" returned: 0 in 0.834s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:32 devstack sudo[105563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0
Jul 06 15:49:32 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Creating offline snapshot ed737ab6-f36e-483c-ac6f-587d99047768 of volume c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad3d59b-d0c0-426d-824b-9b1996d7cd9a]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:32 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5
Jul 06 15:49:32 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:33 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0" returned: 0 in 0.763s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:33 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0
Jul 06 15:49:33 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:33 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" returned: 0 in 0.775s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:33 devstack sudo[105575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768 1G
Jul 06 15:49:33 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:33 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab.53627bd7-5e87-4c7b-a992-e3bb6341a2b0" returned: 0 in 0.656s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-53627bd7-5e87-4c7b-a992-e3bb6341a2b0" released by "_delete_snapshot" :: held 3.199s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:33 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-ea044a7f-392f-497f-9271-0df4455f2aab" released by "delete_snapshot" :: held 3.261s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:34 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Created reservations ['d0a540dd-ff27-41b8-94bd-7ec3e45cb8ec', '90cfe631-ae65-4b30-92c2-f3949c899c5c', '81f43f89-5a0e-4743-a430-3646efb9ae20', '66173fb1-0dc1-4788-8b2c-d9bc2b45cac2'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:34 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Delete snapshot completed successfully.
Jul 06 15:49:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-7b760f20-8d5f-40b3-9340-12d6187fe68d tempest-ProjectMemberTests-1408538130 None] Lock "cinder-53627bd7-5e87-4c7b-a992-e3bb6341a2b0-delete_snapshot" released by "delete_snapshot" :: held 3.402s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:34 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768 1G" returned: 0 in 0.870s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:34 devstack sudo[105582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768
Jul 06 15:49:34 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-ea044a7f-392f-497f-9271-0df4455f2aab-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Lock "cinder-ea044a7f-392f-497f-9271-0df4455f2aab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-ea044a7f-392f-497f-9271-0df4455f2aab" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-ea044a7f-392f-497f-9271-0df4455f2aab" acquired by "delete_volume" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:35 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[499fa616-25d7-4a60-9ba9-4251dde37f7f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:35 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:35 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab
Jul 06 15:49:35 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768" returned: 0 in 0.696s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:35 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768 is being set with open permissions: ugo+rw
Jul 06 15:49:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:35 devstack sudo[105589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768
Jul 06 15:49:35 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:35 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab" returned: 0 in 0.741s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:35 devstack sudo[105595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab
Jul 06 15:49:35 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:35 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768" returned: 0 in 0.691s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:35 devstack sudo[105597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.info
Jul 06 15:49:35 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:36 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea044a7f-392f-497f-9271-0df4455f2aab" returned: 0 in 0.622s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-ea044a7f-392f-497f-9271-0df4455f2aab" released by "delete_volume" :: held 1.428s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Created reservations ['96e9746d-487d-4fa0-8c67-bcfde6a293e5', 'df21cc6d-4bf8-4e63-b2e2-9e030de78b90', 'c6d2acaf-9a93-470a-8ffc-3026efe24aa0', '8861f4ea-9d17-4ea3-9d13-14940b0f9465'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:36 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.info" returned: 0 in 0.652s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:36 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.info is being set with open permissions: ugo+rw
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:36 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.info
Jul 06 15:49:36 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:36 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:49:36 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:37 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.info" returned: 0 in 0.671s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.442s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:37 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9b299fcb-573d-455e-a44f-9256243599c5 tempest-ProjectReaderTests-2141113742 None] Create snapshot completed successfully
Jul 06 15:49:37 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.708s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:49:37 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Deleted volume successfully.
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3c796cf-9a18-4792-ba00-95034e0012ef tempest-ProjectMemberTests-1408538130 None] Lock "cinder-ea044a7f-392f-497f-9271-0df4455f2aab-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (b7f61da6-19cf-417b-86a7-21a10fdb0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d483b32c-2fc7-4876-92ff-f4a4ba61edf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d483b32c-2fc7-4876-92ff-f4a4ba61edf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-829571121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0b93c2-e144-4392-a460-7fbeea3be9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:38Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfc1e7b-288b-4d77-90cc-076e831f1c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfc1e7b-288b-4d77-90cc-076e831f1c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed5c550-f5ed-45ef-936b-b34b2ec7a479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed5c550-f5ed-45ef-936b-b34b2ec7a479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0b93c2-e144-4392-a460-7fbeea3be9c4', 'volume_name': 'volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9773189-b165-4d04-90a5-c3dabd44d2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9773189-b165-4d04-90a5-c3dabd44d2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7639c688-d4c1-43b6-9e8b-1f66304ed841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:37 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Volume 7a0b93c2-e144-4392-a460-7fbeea3be9c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4', 'volume_size': 1}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-829571121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0b93c2-e144-4392-a460-7fbeea3be9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:38Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Creating volume 7a0b93c2-e144-4392-a460-7fbeea3be9c4 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:49:37 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:49:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:37 devstack sudo[105607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 1073741824
Jul 06 15:49:37 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-ed737ab6-f36e-483c-ac6f-587d99047768-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-ed737ab6-f36e-483c-ac6f-587d99047768-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-ed737ab6-f36e-483c-ac6f-587d99047768" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-ed737ab6-f36e-483c-ac6f-587d99047768" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Deleting offline snapshot ed737ab6-f36e-483c-ac6f-587d99047768 of volume c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] snapshot_file for this snap is: volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f408bf-3fc6-4e39-bfeb-30c53de140aa]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:38 devstack sudo[105609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768
Jul 06 15:49:38 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:38 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 1073741824" returned: 0 in 0.832s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:38 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4
Jul 06 15:49:38 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:38 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768" returned: 0 in 0.776s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb7fe84-5ac0-4bb5-890a-3299bfe7c0c5]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:39 devstack sudo[105619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5
Jul 06 15:49:39 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:39 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4" returned: 0 in 0.643s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7639c688-d4c1-43b6-9e8b-1f66304ed841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c253951-8175-42a6-8253-8c1cf93669bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:39 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Volume volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 (7a0b93c2-e144-4392-a460-7fbeea3be9c4): created successfully
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c253951-8175-42a6-8253-8c1cf93669bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (b7f61da6-19cf-417b-86a7-21a10fdb0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:39 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-0c296344-ed95-4913-abe5-a2e84aed3ff5 tempest-ProjectMemberTests-1408538130 None] Created volume successfully.
Jul 06 15:49:39 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" returned: 0 in 0.752s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:39 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768
Jul 06 15:49:39 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Creating offline snapshot 28b6c7e8-5acd-4129-b704-84f9195453bf of volume 7a0b93c2-e144-4392-a460-7fbeea3be9c4 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87f786f-7402-459d-b145-50a7edb2b6e7]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:40 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4
Jul 06 15:49:40 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:40 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768" returned: 0 in 0.716s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:40 devstack sudo[105633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768
Jul 06 15:49:40 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:40 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4" returned: 0 in 0.739s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:40 devstack sudo[105638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf 1G
Jul 06 15:49:40 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:41 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5.ed737ab6-f36e-483c-ac6f-587d99047768" returned: 0 in 0.659s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-ed737ab6-f36e-483c-ac6f-587d99047768" released by "_delete_snapshot" :: held 2.997s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" released by "delete_snapshot" :: held 3.024s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:41 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Created reservations ['78579217-cde9-4678-91dd-4b1a79180f71', 'e7f907c3-8f8f-4ddb-98b3-4fc86ab2e664', '4548db8b-7990-419b-b5fd-2f7751e7860e', '58f091ed-62b6-405f-b232-4e82403a23a3'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:41 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Delete snapshot completed successfully.
Jul 06 15:49:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-fa52c8ad-388d-4191-9d83-b5c100260e03 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-ed737ab6-f36e-483c-ac6f-587d99047768-delete_snapshot" released by "delete_snapshot" :: held 3.185s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:41 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf 1G" returned: 0 in 0.793s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:41 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf
Jul 06 15:49:41 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:42 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf" returned: 0 in 0.667s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:42 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf is being set with open permissions: ugo+rw
Jul 06 15:49:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:42 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf
Jul 06 15:49:42 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Lock "cinder-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:42 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:42 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f20dc5-2ccd-4d9d-b209-92c61660ab5d]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:42 devstack sudo[105652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5
Jul 06 15:49:42 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:42 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf" returned: 0 in 0.659s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:42 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:42 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.info
Jul 06 15:49:42 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:43 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" returned: 0 in 0.811s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:43 devstack sudo[105660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5
Jul 06 15:49:43 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:43 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.info" returned: 0 in 0.667s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:43 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.info is being set with open permissions: ugo+rw
Jul 06 15:49:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:43 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.info
Jul 06 15:49:43 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:43 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:43 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" returned: 0 in 0.681s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:43 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5" released by "delete_volume" :: held 1.550s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:43 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Created reservations ['73598183-4148-4e3f-9f34-5e12d3e6f7cd', 'c98e4d3c-a278-43bc-a749-a62952319575', 'e727447a-4727-4e99-932c-de21fc5f5cb6', '29ec054c-b9bb-4336-a623-26d1b29fa16c'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:44 devstack sudo[105667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:49:44 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:44 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.info" returned: 0 in 0.649s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.255s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:44 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-9a0156cf-c66d-4781-ae65-7c8674d6f72a tempest-ProjectMemberTests-1408538130 None] Create snapshot completed successfully
Jul 06 15:49:44 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.732s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:49:44 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Deleted volume successfully.
Jul 06 15:49:44 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-3dfc7fe2-acea-493b-b76e-d77f0244dd3a tempest-ProjectReaderTests-2141113742 None] Lock "cinder-c1bd5b12-df6a-4a3c-971f-bfac8f2913a5-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Flow 'volume_create_manager' (5ff4f0f2-9783-4560-b302-e3fdca3e0f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1e337c-e158-43b5-936a-ce00de266f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1e337c-e158-43b5-936a-ce00de266f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795799119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeca66f5fcd42c8b5bc16c28199ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:45Z,use_quota=True,user_id='a2b1e79b26ca40689718c2774bd4bb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe33341-5101-4492-a9e1-e353320d5126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe33341-5101-4492-a9e1-e353320d5126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ac149b-62c5-42a4-b66a-7456306ba21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ac149b-62c5-42a4-b66a-7456306ba21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea', 'volume_name': 'volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5edcd4-5f69-4019-ad82-a10f42ae5665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5edcd4-5f69-4019-ad82-a10f42ae5665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9c81af-5d55-4a1a-8907-cd53c4e16d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:45 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Volume 0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea', 'volume_size': 1}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795799119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeca66f5fcd42c8b5bc16c28199ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:45Z,use_quota=True,user_id='a2b1e79b26ca40689718c2774bd4bb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Creating volume 0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:49:45 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-28b6c7e8-5acd-4129-b704-84f9195453bf-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:45 devstack sudo[105670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea 1073741824
Jul 06 15:49:45 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-28b6c7e8-5acd-4129-b704-84f9195453bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-7a0b93c2-e144-4392-a460-7fbeea3be9c4" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-7a0b93c2-e144-4392-a460-7fbeea3be9c4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-28b6c7e8-5acd-4129-b704-84f9195453bf" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-28b6c7e8-5acd-4129-b704-84f9195453bf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Deleting offline snapshot 28b6c7e8-5acd-4129-b704-84f9195453bf of volume 7a0b93c2-e144-4392-a460-7fbeea3be9c4 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] snapshot_file for this snap is: volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d116063d-2480-4830-a63a-58cd15ef88ac]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:45 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:45 devstack sudo[105672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf
Jul 06 15:49:45 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:46 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea 1073741824" returned: 0 in 0.871s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:46 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea
Jul 06 15:49:46 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:46 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf" returned: 0 in 0.865s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31c13fc-bcc0-480b-9218-968477ddd76f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:46 devstack sudo[105682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4
Jul 06 15:49:46 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:46 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" returned: 0 in 0.635s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9c81af-5d55-4a1a-8907-cd53c4e16d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497f91d8-fc92-468b-8e0d-3875d7a58cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:46 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Volume volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea (0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea): created successfully
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497f91d8-fc92-468b-8e0d-3875d7a58cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Flow 'volume_create_manager' (5ff4f0f2-9783-4560-b302-e3fdca3e0f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:46 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a5305ef5-bdc8-4915-bd56-474ed10b1337 tempest-ProjectReaderTests-2141113742 None] Created volume successfully.
Jul 06 15:49:46 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4" returned: 0 in 0.754s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:46 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:46 devstack sudo[105688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf
Jul 06 15:49:46 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:47 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Creating offline snapshot 079e0a30-0a11-4184-811f-77975182f3d5 of volume 0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:49:47 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08cc305-8412-4656-9605-4e6eab912413]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:47 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea
Jul 06 15:49:47 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:47 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf" returned: 0 in 0.744s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:47 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:47 devstack sudo[105695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf
Jul 06 15:49:47 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:48 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" returned: 0 in 0.744s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:48 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5 1G
Jul 06 15:49:48 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:48 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4.28b6c7e8-5acd-4129-b704-84f9195453bf" returned: 0 in 0.640s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-28b6c7e8-5acd-4129-b704-84f9195453bf" released by "_delete_snapshot" :: held 3.105s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-7a0b93c2-e144-4392-a460-7fbeea3be9c4" released by "delete_snapshot" :: held 3.132s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:48 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Created reservations ['88d37b78-7a7a-439e-8bbd-130d77f465f6', 'fa48a547-fc55-449b-8602-fa9b82bde535', '0dae3243-62f3-42e0-8892-daa8e6bb9cc1', '55e1cc30-2726-438c-9dd7-398fb2170256'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:48 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Delete snapshot completed successfully.
Jul 06 15:49:48 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-e3caa03e-770c-470b-a42f-5d5e5903c468 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-28b6c7e8-5acd-4129-b704-84f9195453bf-delete_snapshot" released by "delete_snapshot" :: held 3.268s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:48 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5 1G" returned: 0 in 0.813s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:48 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:48 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5
Jul 06 15:49:48 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-7a0b93c2-e144-4392-a460-7fbeea3be9c4-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-7a0b93c2-e144-4392-a460-7fbeea3be9c4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-7a0b93c2-e144-4392-a460-7fbeea3be9c4" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:49 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-7a0b93c2-e144-4392-a460-7fbeea3be9c4" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:49 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[816583fc-6a5a-4f3d-b4ec-5856f78ed95b]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:49 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5" returned: 0 in 0.709s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:49 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5 is being set with open permissions: ugo+rw
Jul 06 15:49:49 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:49 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4
Jul 06 15:49:49 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:49 devstack sudo[105713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5
Jul 06 15:49:49 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:50 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5" returned: 0 in 0.655s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:50 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4" returned: 0 in 0.766s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:50 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4
Jul 06 15:49:50 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:50 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.info
Jul 06 15:49:50 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:50 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-7a0b93c2-e144-4392-a460-7fbeea3be9c4" returned: 0 in 0.655s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:50 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-7a0b93c2-e144-4392-a460-7fbeea3be9c4" released by "delete_volume" :: held 1.482s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:50 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.info" returned: 0 in 0.665s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:50 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.info is being set with open permissions: ugo+rw
Jul 06 15:49:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:50 devstack sudo[105729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.info
Jul 06 15:49:51 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Created reservations ['8ddb88e4-073f-484e-8581-3937ad1bb4bc', 'eaca11e8-79e8-4911-999e-bceab0b0ff61', '51cf7b7c-9681-4992-a40d-a134e5789882', 'a73c7b58-c167-40da-a0af-5f077d864ab8'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:51 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:49:51 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:51 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.info" returned: 0 in 0.676s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.368s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:51 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-eaeaaece-8a63-4997-aac0-0b3a9e5d8435 tempest-ProjectReaderTests-2141113742 None] Create snapshot completed successfully
Jul 06 15:49:51 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.665s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:49:51 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Deleted volume successfully.
Jul 06 15:49:51 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-ff82a093-d1f4-4d98-90e7-5484c957cae9 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-7a0b93c2-e144-4392-a460-7fbeea3be9c4-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (b152dcbf-f88b-4b06-b8df-5f1a01719907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81706dd6-c121-4434-8b47-64b90b063412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81706dd6-c121-4434-8b47-64b90b063412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290452495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:52Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cee737-5c8c-4802-aab8-0173ae7e627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cee737-5c8c-4802-aab8-0173ae7e627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a059b7-e047-404f-92bb-f0cc7fb08733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a059b7-e047-404f-92bb-f0cc7fb08733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2', 'volume_name': 'volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3bd4d4-8575-461c-babc-1307a55f478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3bd4d4-8575-461c-babc-1307a55f478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17dc4fb-3820-496e-bf87-cbe83ad08a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:52 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Volume 1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2', 'volume_size': 1}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290452495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdb9d577f9e4104aed9edd566cd4d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:52Z,use_quota=True,user_id='62722e9d4d4b4a1bbc9aefd056219d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Creating volume 1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:49:52 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:52 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 1073741824
Jul 06 15:49:52 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-079e0a30-0a11-4184-811f-77975182f3d5-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-079e0a30-0a11-4184-811f-77975182f3d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-079e0a30-0a11-4184-811f-77975182f3d5" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-079e0a30-0a11-4184-811f-77975182f3d5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Deleting offline snapshot 079e0a30-0a11-4184-811f-77975182f3d5 of volume 0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] snapshot_file for this snap is: volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9516c40-4210-47e6-b8b7-5cc2bbcaffde]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:52 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:52 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5
Jul 06 15:49:52 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:53 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 1073741824" returned: 0 in 0.799s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:53 devstack sudo[105742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2
Jul 06 15:49:53 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:53 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5" returned: 0 in 0.800s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[534c2dd8-380b-465b-b5b3-19d30ff28641]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:53 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea
Jul 06 15:49:53 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:53 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" returned: 0 in 0.668s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17dc4fb-3820-496e-bf87-cbe83ad08a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851e58cf-9a12-497c-bc80-561dd868f9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:49:53 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Volume volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 (1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2): created successfully
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851e58cf-9a12-497c-bc80-561dd868f9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:49:53 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Flow 'volume_create_manager' (b152dcbf-f88b-4b06-b8df-5f1a01719907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:49:53 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a3915cdd-ac70-4c56-a4d7-bd531a4a52e0 tempest-ProjectMemberTests-1408538130 None] Created volume successfully.
Jul 06 15:49:54 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" returned: 0 in 0.839s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:54 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5
Jul 06 15:49:54 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:54 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Creating offline snapshot d34868d9-bace-4c77-ad3e-83fe1627438e of volume 1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 {{(pid=86249) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 15:49:54 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[120591b6-5c81-4bb7-87fd-93b47ec3c89c]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:54 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:54 devstack sudo[105755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2
Jul 06 15:49:54 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:55 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5" returned: 0 in 0.797s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:55 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5
Jul 06 15:49:55 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:55 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" returned: 0 in 0.753s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e 1G {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:55 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e 1G
Jul 06 15:49:55 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:55 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea.079e0a30-0a11-4184-811f-77975182f3d5" returned: 0 in 0.655s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-079e0a30-0a11-4184-811f-77975182f3d5" released by "_delete_snapshot" :: held 3.186s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" released by "delete_snapshot" :: held 3.214s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:55 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Created reservations ['5afe05b6-3185-457c-a125-9dfd31aa7e03', 'ecd62751-7332-42af-b06e-7fec07e30113', '4ba2c524-13c0-4869-ba7a-4051c82ca87a', '4e26ab12-f373-4114-8bb1-f238900f9243'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:55 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Delete snapshot completed successfully.
Jul 06 15:49:55 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-6ff62208-3f84-4412-aa60-5ac536865b07 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-079e0a30-0a11-4184-811f-77975182f3d5-delete_snapshot" released by "delete_snapshot" :: held 3.369s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:55 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:55 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e 1G" returned: 0 in 0.816s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:56 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e
Jul 06 15:49:56 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:56 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 -F qcow2 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e" returned: 0 in 0.703s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:56 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e is being set with open permissions: ugo+rw
Jul 06 15:49:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:56 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e
Jul 06 15:49:56 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "cinder-quobyte-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:56 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" acquired by "delete_volume" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:56 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53ada5c-a537-4f8d-95b9-e3299bbc544f]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:57 devstack sudo[105779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea
Jul 06 15:49:57 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:57 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e" returned: 0 in 0.665s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:57 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.info
Jul 06 15:49:57 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:57 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" returned: 0 in 0.838s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:57 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:57 devstack sudo[105787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea
Jul 06 15:49:57 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:58 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.info" returned: 0 in 0.639s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:58 devstack cinder-volume[86249]: WARNING cinder.volume.drivers.remotefs [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.info is being set with open permissions: ugo+rw
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.info {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:58 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.info
Jul 06 15:49:58 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:58 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" returned: 0 in 0.635s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-quobyte-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea" released by "delete_volume" :: held 1.530s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Created reservations ['02942065-93e1-42c5-9b9b-d92755802fac', '453fc06d-0a1e-4f1e-9bfe-9ab70323cb7b', '620e8e2e-258c-4c89-9f36-96cfed498c43', 'd1ee3d1f-9328-4823-982b-a2cb556d0b70'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:58 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:49:58 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:49:58 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.info" returned: 0 in 0.676s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:58 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.331s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:49:58 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-43a400d4-5291-46b4-b552-2be95d4300a3 tempest-ProjectMemberTests-1408538130 None] Create snapshot completed successfully
Jul 06 15:49:59 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.692s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:49:59 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Deleted volume successfully.
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a9e17b3b-a1ce-4133-abcb-8a83d56e1331 tempest-ProjectReaderTests-2141113742 None] Lock "cinder-0e2f3bee-9dfd-49a8-b5e4-104c4716f5ea-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-d34868d9-bace-4c77-ad3e-83fe1627438e-delete_snapshot" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-d34868d9-bace-4c77-ad3e-83fe1627438e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" by "delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-d34868d9-bace-4c77-ad3e-83fe1627438e" by "_delete_snapshot" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-d34868d9-bace-4c77-ad3e-83fe1627438e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Deleting offline snapshot d34868d9-bace-4c77-ad3e-83fe1627438e of volume 1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] snapshot_file for this snap is: volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e {{(pid=86249) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bd8320-e32a-4ea3-93a2-e773831a43d5]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:49:59 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:49:59 devstack sudo[105797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e
Jul 06 15:49:59 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:00 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e" returned: 0 in 0.813s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:00 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86249) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 15:50:00 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef821dc-897a-43d8-9c81-a355addbff0e]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:50:00 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:00 devstack sudo[105804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2
Jul 06 15:50:00 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:01 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" returned: 0 in 0.738s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:01 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:01 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e
Jul 06 15:50:01 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:02 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e" returned: 0 in 0.695s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:02 devstack sudo[105814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e
Jul 06 15:50:02 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:02 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:02 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2.d34868d9-bace-4c77-ad3e-83fe1627438e" returned: 0 in 0.631s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-d34868d9-bace-4c77-ad3e-83fe1627438e" released by "_delete_snapshot" :: held 2.985s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" released by "delete_snapshot" :: held 3.007s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:02 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Created reservations ['e5bdfcac-7b86-44bb-b645-a2ed7e242c73', '448e3252-ec58-4f92-b7e1-8396aefc548b', '04869339-fc9b-4777-8203-111ef082eb40', 'b41e7d38-60d7-46a9-87ca-6a014db2d64e'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:50:02 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Delete snapshot completed successfully.
Jul 06 15:50:02 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-789775f0-27f8-4f3b-9262-791bd6117c94 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-d34868d9-bace-4c77-ad3e-83fe1627438e-delete_snapshot" released by "delete_snapshot" :: held 3.145s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:50:03 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:50:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "cinder-quobyte-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:50:04 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" acquired by "delete_volume" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:50:04 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ec2a66-c326-4b7c-b8d3-9d3907bfc870]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:50:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:04 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2
Jul 06 15:50:04 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:04 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" returned: 0 in 0.718s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:04 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:04 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2
Jul 06 15:50:04 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:05 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" returned: 0 in 0.593s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:05 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-quobyte-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2" released by "delete_volume" :: held 1.365s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:05 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Created reservations ['b4d79b94-1965-46b8-a072-355c4bae74f6', 'b867e374-95c0-4c86-ba3e-d61da57a2610', 'e8810d1b-0567-46bd-8e64-5aa27397e40b', 'd146cd7e-83e1-46db-9d0d-f8306831f4d1'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:50:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:50:05 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:50:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:05 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:05 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:50:05 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:06 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.640s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:06 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:50:06 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Deleted volume successfully.
Jul 06 15:50:06 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-50e656f7-96f4-4939-b711-6d1645717ae7 tempest-ProjectMemberTests-1408538130 None] Lock "cinder-1cfcb71b-9c85-4edb-b3a0-dbc9a33ed5e2-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:50:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:50:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:50:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:06 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:50:06 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:07 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.632s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:50:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:50:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:50:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 15:50:15 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=85,cinder:DELETE=5,cinder:SELECT=66,cinder:INSERT=24 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:50:16 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=89,cinder:DELETE=9,cinder:SELECT=65,cinder:INSERT=23 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Flow 'volume_create_manager' (36197a70-dd60-4623-9cb8-feaf5a58c6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bff7ba2-b85b-45e2-9d5d-ac47bfaf06f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bff7ba2-b85b-45e2-9d5d-ac47bfaf06f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-145915481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b4a417-472b-49a9-b0eb-967d6c73eaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ce865686b4a329466467c2bfccabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:22Z,use_quota=True,user_id='3419ace0e3884927a4dc46088a089000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e402fd-0ae9-460a-8815-b13f195cdaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e402fd-0ae9-460a-8815-b13f195cdaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a9d533-dd76-487d-9a33-cec99f3b1a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a9d533-dd76-487d-9a33-cec99f3b1a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b4a417-472b-49a9-b0eb-967d6c73eaea', 'volume_name': 'volume-19b4a417-472b-49a9-b0eb-967d6c73eaea', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcc6f90-3f32-4e46-884a-321090a7441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcc6f90-3f32-4e46-884a-321090a7441b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e232e9-15a0-41ef-8f0f-13e882dc436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:22 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Volume 19b4a417-472b-49a9-b0eb-967d6c73eaea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b4a417-472b-49a9-b0eb-967d6c73eaea', 'volume_size': 1}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-145915481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b4a417-472b-49a9-b0eb-967d6c73eaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ce865686b4a329466467c2bfccabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:22Z,use_quota=True,user_id='3419ace0e3884927a4dc46088a089000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Creating volume 19b4a417-472b-49a9-b0eb-967d6c73eaea {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:50:22 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:50:22 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:22 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea 1073741824
Jul 06 15:50:22 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:23 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea 1073741824" returned: 0 in 0.869s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:23 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea
Jul 06 15:50:23 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:23 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea" returned: 0 in 0.623s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:23 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:50:23 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e232e9-15a0-41ef-8f0f-13e882dc436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b4a417-472b-49a9-b0eb-967d6c73eaea', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f785eed-92a5-4b34-89ee-2ea2e6b0e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:24 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Volume volume-19b4a417-472b-49a9-b0eb-967d6c73eaea (19b4a417-472b-49a9-b0eb-967d6c73eaea): created successfully
Jul 06 15:50:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f785eed-92a5-4b34-89ee-2ea2e6b0e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:24 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Flow 'volume_create_manager' (36197a70-dd60-4623-9cb8-feaf5a58c6f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:50:24 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a2fed168-240c-4974-b5f9-f76105225f3d tempest-ProjectReaderTests-321688958 None] Created volume successfully.
Jul 06 15:50:24 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Acquiring lock "cinder-19b4a417-472b-49a9-b0eb-967d6c73eaea-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:50:24 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Lock "cinder-19b4a417-472b-49a9-b0eb-967d6c73eaea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:50:24 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Acquiring lock "cinder-quobyte-19b4a417-472b-49a9-b0eb-967d6c73eaea" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:50:24 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Lock "cinder-quobyte-19b4a417-472b-49a9-b0eb-967d6c73eaea" acquired by "delete_volume" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:50:24 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6aa4cd-4da8-4115-92f1-ace1f98eeb45]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:50:24 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:24 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea
Jul 06 15:50:24 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:25 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea" returned: 0 in 0.754s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:25 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:25 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea
Jul 06 15:50:25 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:26 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-19b4a417-472b-49a9-b0eb-967d6c73eaea" returned: 0 in 0.598s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Lock "cinder-quobyte-19b4a417-472b-49a9-b0eb-967d6c73eaea" released by "delete_volume" :: held 1.419s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Created reservations ['af3b316e-5831-406f-b11f-cd1ca1076afa', 'c59bbb0d-8b3b-420a-ac35-a08aa4dc4b54', 'e1ebb8f0-860e-4895-ab87-270301db5f50', '0d30e3bb-e571-4314-a80c-611bcd95d9be'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:26 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:50:26 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:26 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.611s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:50:26 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Deleted volume successfully.
Jul 06 15:50:26 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-2eb59800-a45b-4c70-ac09-13a4452275a8 tempest-ProjectReaderTests-321688958 None] Lock "cinder-19b4a417-472b-49a9-b0eb-967d6c73eaea-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Flow 'volume_create_manager' (5373f2a0-55d2-4688-ab47-115d141af44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b16db0e-4563-4d89-822b-0e7a17eb02cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b16db0e-4563-4d89-822b-0e7a17eb02cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084903126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27222c7f-e4c1-42d8-84e0-d2aad7142122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ce865686b4a329466467c2bfccabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:27Z,use_quota=True,user_id='3419ace0e3884927a4dc46088a089000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c815827-6fad-4017-b052-6b0e44384bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c815827-6fad-4017-b052-6b0e44384bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc17ea6e-2c3a-421c-9034-b560539ac706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc17ea6e-2c3a-421c-9034-b560539ac706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27222c7f-e4c1-42d8-84e0-d2aad7142122', 'volume_name': 'volume-27222c7f-e4c1-42d8-84e0-d2aad7142122', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0129757e-42e5-4fcf-a7b8-758e145100aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0129757e-42e5-4fcf-a7b8-758e145100aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8960f6-e1c5-450f-93dd-384fd9763adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:27 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Volume 27222c7f-e4c1-42d8-84e0-d2aad7142122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27222c7f-e4c1-42d8-84e0-d2aad7142122', 'volume_size': 1}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084903126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27222c7f-e4c1-42d8-84e0-d2aad7142122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ce865686b4a329466467c2bfccabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:27Z,use_quota=True,user_id='3419ace0e3884927a4dc46088a089000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Creating volume 27222c7f-e4c1-42d8-84e0-d2aad7142122 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:50:27 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:50:27 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:27 devstack sudo[105899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122 1073741824
Jul 06 15:50:27 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:28 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122 1073741824" returned: 0 in 0.823s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:28 devstack sudo[105904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122
Jul 06 15:50:28 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:28 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122" returned: 0 in 0.621s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:28 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:50:28 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8960f6-e1c5-450f-93dd-384fd9763adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27222c7f-e4c1-42d8-84e0-d2aad7142122', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9910f604-889e-4458-9fb6-b8955dd96207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:28 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Volume volume-27222c7f-e4c1-42d8-84e0-d2aad7142122 (27222c7f-e4c1-42d8-84e0-d2aad7142122): created successfully
Jul 06 15:50:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9910f604-889e-4458-9fb6-b8955dd96207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:28 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Flow 'volume_create_manager' (5373f2a0-55d2-4688-ab47-115d141af44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:50:28 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-733d4533-270c-413c-810e-ec709e0bcf3a tempest-ProjectReaderTests-321688958 None] Created volume successfully.
Jul 06 15:50:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Acquiring lock "cinder-27222c7f-e4c1-42d8-84e0-d2aad7142122-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:50:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Lock "cinder-27222c7f-e4c1-42d8-84e0-d2aad7142122-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:50:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Acquiring lock "cinder-quobyte-27222c7f-e4c1-42d8-84e0-d2aad7142122" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:50:29 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Lock "cinder-quobyte-27222c7f-e4c1-42d8-84e0-d2aad7142122" acquired by "delete_volume" :: waited 0.013s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:50:29 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca44091-b245-428e-a67d-0715777846d0]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:50:29 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:29 devstack sudo[105907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122
Jul 06 15:50:29 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:30 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122" returned: 0 in 0.700s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:30 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122
Jul 06 15:50:30 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:30 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-27222c7f-e4c1-42d8-84e0-d2aad7142122" returned: 0 in 0.615s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Lock "cinder-quobyte-27222c7f-e4c1-42d8-84e0-d2aad7142122" released by "delete_volume" :: held 1.350s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Created reservations ['e7724d8a-fe85-43f9-889d-29d09d00eaa8', '577250fe-1608-4991-9899-94a0fea87c77', 'f4be0889-ab95-428d-b965-4ac9127ba527', '7ada4e85-96be-4c27-8b44-9aab5190ff83'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:30 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:30 devstack sudo[105916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:50:30 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:31 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:31 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.627s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:31 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:50:31 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Deleted volume successfully.
Jul 06 15:50:31 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-a41ccd88-2856-406e-b7f5-42e9b72738f9 tempest-ProjectReaderTests-321688958 None] Lock "cinder-27222c7f-e4c1-42d8-84e0-d2aad7142122-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Flow 'volume_create_manager' (0b82ac92-400c-4492-8788-1f074dd3107a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5d3c90-dc9d-4f92-864b-c9bd8aeb6b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5d3c90-dc9d-4f92-864b-c9bd8aeb6b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787082847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770241d0-3346-407b-8448-cc0f16d446b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ce865686b4a329466467c2bfccabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:32Z,use_quota=True,user_id='3419ace0e3884927a4dc46088a089000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cf2796-5340-4ce4-b9cb-b26392972357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cf2796-5340-4ce4-b9cb-b26392972357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d47915-3ed6-4b45-96ed-1d1cfc83a963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d47915-3ed6-4b45-96ed-1d1cfc83a963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770241d0-3346-407b-8448-cc0f16d446b6', 'volume_name': 'volume-770241d0-3346-407b-8448-cc0f16d446b6', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a831e7-3d34-4658-abc1-9b297e366a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a831e7-3d34-4658-abc1-9b297e366a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f52cf3b-7685-43e8-a16c-2cbc15981de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:32 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Volume 770241d0-3346-407b-8448-cc0f16d446b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770241d0-3346-407b-8448-cc0f16d446b6', 'volume_size': 1}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787082847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770241d0-3346-407b-8448-cc0f16d446b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ce865686b4a329466467c2bfccabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:32Z,use_quota=True,user_id='3419ace0e3884927a4dc46088a089000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Creating volume 770241d0-3346-407b-8448-cc0f16d446b6 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:50:32 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:50:32 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:32 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6 1073741824
Jul 06 15:50:32 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:32 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6 1073741824" returned: 0 in 0.859s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:33 devstack sudo[105924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6
Jul 06 15:50:33 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:33 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6" returned: 0 in 0.606s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:33 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:50:33 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f52cf3b-7685-43e8-a16c-2cbc15981de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770241d0-3346-407b-8448-cc0f16d446b6', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9889349-3821-4123-88df-2c5e30a036cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:33 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Volume volume-770241d0-3346-407b-8448-cc0f16d446b6 (770241d0-3346-407b-8448-cc0f16d446b6): created successfully
Jul 06 15:50:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9889349-3821-4123-88df-2c5e30a036cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:33 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Flow 'volume_create_manager' (0b82ac92-400c-4492-8788-1f074dd3107a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:50:33 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-c258f912-86b9-48c1-9ce9-a79a30b085d3 tempest-ProjectReaderTests-321688958 None] Created volume successfully.
Jul 06 15:50:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Acquiring lock "cinder-770241d0-3346-407b-8448-cc0f16d446b6-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:50:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Lock "cinder-770241d0-3346-407b-8448-cc0f16d446b6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:50:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Acquiring lock "cinder-quobyte-770241d0-3346-407b-8448-cc0f16d446b6" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:50:34 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Lock "cinder-quobyte-770241d0-3346-407b-8448-cc0f16d446b6" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:50:34 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7fd679-2b3e-4e80-9e27-a31cfe0fe346]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:50:34 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:34 devstack sudo[105927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6
Jul 06 15:50:34 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:35 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6" returned: 0 in 0.749s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:35 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6
Jul 06 15:50:35 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:35 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-770241d0-3346-407b-8448-cc0f16d446b6" returned: 0 in 0.607s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Lock "cinder-quobyte-770241d0-3346-407b-8448-cc0f16d446b6" released by "delete_volume" :: held 1.395s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Created reservations ['31d65c83-5fca-4bf6-8d5f-8f04bea8ad22', '269fe88b-afd7-4abf-b792-9cec4c7910e3', '0b990ab8-fba1-47ea-a565-e53040eb905b', 'be8f9e9f-2edd-4efd-986a-16cdc1883a45'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:35 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:35 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:50:35 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:36 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.598s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:50:36 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Deleted volume successfully.
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-4a02c896-ac50-4a5d-b0ea-02eb3a029975 tempest-ProjectReaderTests-321688958 None] Lock "cinder-770241d0-3346-407b-8448-cc0f16d446b6-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86249) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Flow 'volume_create_manager' (0356acbe-347f-4921-b4be-6248a348c231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02236b2-fd2c-40c0-9648-9b9e035b9927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02236b2-fd2c-40c0-9648-9b9e035b9927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-831608967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3c8521-f5aa-45db-b287-313edfa62532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ce865686b4a329466467c2bfccabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:37Z,use_quota=True,user_id='3419ace0e3884927a4dc46088a089000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf47b39c-7cd3-45a9-85a5-d767d9ecce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf47b39c-7cd3-45a9-85a5-d767d9ecce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e7fc3c-ca9c-4090-9201-2066f84428c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e7fc3c-ca9c-4090-9201-2066f84428c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3c8521-f5aa-45db-b287-313edfa62532', 'volume_name': 'volume-ea3c8521-f5aa-45db-b287-313edfa62532', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc211d0d-d428-4c90-83a8-0177a8abc244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc211d0d-d428-4c90-83a8-0177a8abc244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3775b2e-f07a-4c6f-9c33-5487f8c31361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:36 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Volume ea3c8521-f5aa-45db-b287-313edfa62532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3c8521-f5aa-45db-b287-313edfa62532', 'volume_size': 1}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x78b2ca40a420>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T13:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-831608967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3c8521-f5aa-45db-b287-313edfa62532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796ce865686b4a329466467c2bfccabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:37Z,use_quota=True,user_id='3419ace0e3884927a4dc46088a089000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee36a1be-f278-426b-b4c0-333979031166),volume_type_id=ee36a1be-f278-426b-b4c0-333979031166)}" {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.remotefs [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Creating volume ea3c8521-f5aa-45db-b287-313edfa62532 {{(pid=86249) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Selected osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc as target Quobyte volume. {{(pid=86249) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 15:50:36 devstack cinder-volume[86249]: INFO cinder.volume.drivers.remotefs [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] casted to osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc
Jul 06 15:50:36 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532 1073741824 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:36 devstack sudo[105938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532 1073741824
Jul 06 15:50:36 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:37 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532 1073741824" returned: 0 in 0.801s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:37 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:37 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532
Jul 06 15:50:37 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:38 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532" returned: 0 in 0.614s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'} {{(pid=86249) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3775b2e-f07a-4c6f-9c33-5487f8c31361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3c8521-f5aa-45db-b287-313edfa62532', 'volume_size': 1}' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7b0a66-4bd4-43d2-be20-c0f6c42d1e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 15:50:38 devstack cinder-volume[86249]: INFO cinder.volume.flows.manager.create_volume [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Volume volume-ea3c8521-f5aa-45db-b287-313edfa62532 (ea3c8521-f5aa-45db-b287-313edfa62532): created successfully
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7b0a66-4bd4-43d2-be20-c0f6c42d1e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86249) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Flow 'volume_create_manager' (0356acbe-347f-4921-b4be-6248a348c231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86249) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 15:50:38 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-b56dbe57-788a-4292-8ee2-0b0f2b700ed9 tempest-ProjectReaderTests-321688958 None] Created volume successfully.
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Acquiring lock "cinder-ea3c8521-f5aa-45db-b287-313edfa62532-delete_volume" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Lock "cinder-ea3c8521-f5aa-45db-b287-313edfa62532-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Acquiring lock "cinder-quobyte-ea3c8521-f5aa-45db-b287-313edfa62532" by "delete_volume" {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 15:50:38 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Lock "cinder-quobyte-ea3c8521-f5aa-45db-b287-313edfa62532" acquired by "delete_volume" :: waited 0.014s {{(pid=86249) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 15:50:39 devstack cinder-volume[86249]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e0e246-02a2-48e5-8ca7-4cb0bc460381]: (4, 'qcow2') {{(pid=86765) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 15:50:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:39 devstack sudo[105946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532
Jul 06 15:50:39 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:39 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532" returned: 0 in 0.729s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:39 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:39 devstack sudo[105951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532
Jul 06 15:50:39 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:40 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804/volume-ea3c8521-f5aa-45db-b287-313edfa62532" returned: 0 in 0.606s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:40 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Lock "cinder-quobyte-ea3c8521-f5aa-45db-b287-313edfa62532" released by "delete_volume" :: held 1.371s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:40 devstack cinder-volume[86249]: DEBUG cinder.quota [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Created reservations ['16af65ae-a66d-4a4c-8d81-6bbd17dad04e', '240aa6dc-459e-4a0a-aa33-99f629866cf9', '4e00b44c-16a7-428f-94ac-b6aeec527cac', '60ca39b9-8331-46e4-a1d4-c625e669acfd'] {{(pid=86249) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 15:50:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:50:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:50:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:50:40 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:50:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:50:40 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:50:40 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:50:40 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:50:41 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Jul 06 15:50:41 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.592s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:50:41 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:50:41 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Deleted volume successfully.
Jul 06 15:50:41 devstack cinder-volume[86249]: DEBUG cinder.coordination [None req-97b75014-e328-409c-ba3d-40cbaeaa5d0c tempest-ProjectReaderTests-321688958 None] Lock "cinder-ea3c8521-f5aa-45db-b287-313edfa62532-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=86249) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 15:50:50 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:UPDATE=44,cinder:INSERT=11,cinder:DELETE=3,cinder:SELECT=23 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:50:51 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writing DB stats cinder:SELECT=33,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 15:51:06 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:51:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 15:51:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 15:51:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc': None} {{(pid=86249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 15:51:06 devstack cinder-volume[86249]: DEBUG cinder.volume.drivers.quobyte [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d7b384e-8f45-4005-8454-9fa1f40b61fc'] {{(pid=86249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 15:51:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 15:51:06 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804 {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 15:51:06 devstack sudo[106212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804
Jul 06 15:51:06 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 15:51:07 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root
Jul 06 15:51:07 devstack cinder-volume[86249]: DEBUG oslo_concurrency.processutils [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21b103369c122d14a864d72359359804" returned: 0 in 0.618s {{(pid=86249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 15:51:07 devstack cinder-volume[86249]: DEBUG cinder.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Notifying Schedulers of capabilities ... {{(pid=86249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 15:51:07 devstack cinder-volume[86249]: DEBUG oslo_service.periodic_task [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] Running periodic task VolumeManager._thread_info {{(pid=86249) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 15:51:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread count: 28 {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 15:51:07 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-e75033d1-0a69-4bf4-8d79-6bb471146a5d None None] thread info: [<_MainThread(MainThread, started 132709393645696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132709283309888)>, <Thread(Thread-3 (stat_writer), started daemon 132709282921408)>, <Thread(Rabbit-heartbeat, started daemon 132709282013440)>, <Thread(Thread-5 (_runner), started daemon 132709280213376)>, <Thread(Thread-7 (_runner), started daemon 132709280277120)>, <Thread(fd_logger, started daemon 132709278159872)>, <Thread(privsep_reader, started daemon 132709278165952)>, <Thread(tpool_thread_0, started daemon 132709268440768)>, <Thread(tpool_thread_1, started daemon 132709260048064)>, <Thread(tpool_thread_2, started daemon 132709251655360)>, <Thread(tpool_thread_3, started daemon 132709243246272)>, <Thread(tpool_thread_4, started daemon 132709234837184)>, <Thread(tpool_thread_5, started daemon 132709226428096)>, <Thread(tpool_thread_6, started daemon 132709218019008)>, <Thread(tpool_thread_7, started daemon 132709209609920)>, <Thread(tpool_thread_8, started daemon 132709201200832)>, <Thread(tpool_thread_9, started daemon 132709192791744)>, <Thread(tpool_thread_10, started daemon 132709184382656)>, <Thread(tpool_thread_11, started daemon 132709175973568)>, <Thread(tpool_thread_12, started daemon 132709167564480)>, <Thread(tpool_thread_13, started daemon 132709159155392)>, <Thread(tpool_thread_14, started daemon 132709150746304)>, <Thread(tpool_thread_15, started daemon 132709142337216)>, <Thread(tpool_thread_16, started daemon 132709133928128)>, <Thread(tpool_thread_17, started daemon 132709125519040)>, <Thread(tpool_thread_18, started daemon 132709117109952)>, <Thread(tpool_thread_19, started daemon 132709108700864)>] {{(pid=86249) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}